BIG DATA WITH MATLAB: DISTRIBUTED AND PARALLEL COMPUTING. SPARK AND HADOOP CLUSTERS
Usually printed in 3 - 5 business days
MATLAB includes a number of tools for accessing and processing large data. Is possible create a datastore that can access small portions of the data at a time. You can use the datastore to manage incremental import of the data. To analyze the data using common MATLAB functions, create a tall array on top of the datastore. For more complex problems, you can write a MapReduce algorithm that defines the chunking and reduction of the data. In MATLAB you can access remote data using datastore objects. You can create a datastore to work with data stored in remote locations, such as cloud storage using Amazon S3 (Simple Storage Service) and Hadoop Distributed File System (HDFS). Use the datastore to examine part of your data from your desktop version of MATLAB. Then, after prototyping your code locally, you can scale up to a cluster or cloud. Scaling up improves execution efficiency as it is more efficient to run large calculations in the same location as the data. In MATLAB is possible create a tall table to run on a Spark enabled Hadoop cluster. You can use this tall table to create tall arrays and calculate statistical properties. You can develop code locally and then scale up, to take advantage of the capabilities offered by Parallel Computing Toolbox and MATLAB Distributed Computing Server without having to rewrite your algorithm.
Details
- Publication Date
- Sep 14, 2026
- Language
- English
- ISBN
- 9781291528206
- Category
- Computers & Technology
- Copyright
- All Rights Reserved - Standard Copyright License
- Contributors
- By (author): Cesar Perez Lopez
Specifications
- Pages
- 223
- Binding Type
- Paperback Perfect Bound
- Interior Color
- Black & White
- Dimensions
- Executive (7 x 10 in / 178 x 254 mm)