Share E-Book
Scan to open this page

Scan with your phone to open this page

AuthorTom White

Get ready to unlock the power of your data. With the fourth edition of this comprehensive guide, you’ll learn how to build and maintain reliable, scalable, distributed systems with Apache Hadoop. This book is ideal for programmers looking to analyze datasets of any size, and for administrators who want to set up and run Hadoop clusters. Using Hadoop 2 exclusively, author Tom White presents new chapters on YARN and several Hadoop-related projects such as Parquet, Flume, Crunch, and Spark. You’ll learn about recent changes to Hadoop, and explore new case studies on Hadoop’s role in healthcare systems and genomics data processing. Learn fundamental components such as MapReduce, HDFS, and YARN Explore MapReduce in depth, including steps for developing applications with it Set up and maintain a Hadoop cluster running HDFS and MapReduce on YARN Learn two data formats: Avro for data serialization and Parquet for nested data Use data ingestion tools such as Flume (for streaming data) and Sqoop (for bulk data transfer) Understand how high-level data processing tools like Pig, Hive, Crunch, and Spark work with Hadoop Learn the HBase distributed database and the ZooKeeper distributed configuration service

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

Brief outline
【One-Line Pitch】 Get ready to unlock the power of your data. With the fourth edition of this comprehensive guide, you’ll learn how to … 【Book Arc】 - **Opening (~0%–12%)**: 书名: Hadoop The Definitive Guide (Tom White) (Z-Library) 作者: Tom White Get ready to unlock the power of your data.; such an event, the whole Hadoop system would effectively be out of service until a new namenode could be brought online. - **Early (~12%–35%)**: or each path in turn and accumulating the FileStatus object arrays in a single array.; to be shared fairly between applications, rather than users. - **Middle (~35%–65%)**: erge.inmem.threshold), it is merged and spilled to disk.; Let’s try extends Mapper NullWritable, BytesWritable, Text, BytesWritable { private Text filenameKey; - **Late (~65%–88%)**: from old datanodes to new datanodes to balance the cluster.; REDUCE_JOB_USER_CLASSPATH_FIRST, true); - **Ending (~88%–100%)**: es for representing nested structures: tuple, bag, and map.; For example, it’s not possible to create a relation from a bag literal. 【Key Takeaways】 - **书名: Hadoop The Definit…** (Opening): 书名: Hadoop The Definitive Guide (Tom White) (Z-Library) 作者: Tom White Get ready to unlock the power of your data. - **such an event** (Opening): such an event, the whole Hadoop system would effectively be out of service until a new namenode could be brought online. - **es periodic checkpoint…** (Opening): es periodic checkpoints of the active namenode’s namespace. - **or each path in turn a…** (Early): or each path in turn and accumulating the FileStatus object arrays in a single array. - **to be shared fairly be…** (Early): to be shared fairly between applications, rather than users. - **ly the size of an HDFS…** (Early): ly the size of an HDFS block. 【Reading Tips】 - Use Passage locations below to jump into the text and set reading anchors - If this is a brief outline, click Regenerate (top right) for a synthesized guide 【Coverage Limits】 Compressed outline without the model (~33 index chunks). Full structured guide needs AI available.
Page 15
ly searchable database from publishers like O’Reilly Media, Prentice Hall Professional, Addison-Wesley Professional, Microsoft Press, Sams, Que, Peachpit Pre...
View in text
Excerpt 2
to be shared fairly between applications, rather than users. The definition is equivalent to this: <queuePlacementPolicy> <rule name="default" /> </queuePlac...
View in text
Excerpt 3
emperature.MALFORMED).increment(1); } } } Hadoop Logs Hadoop produces logs in various places, and for various audiences. These are summarized in Table 6-2. T...
View in text
Excerpt 4
file path. The path is stored in a Text object for the key. The reducer is the identity (not explicitly set), and the output format is a SequenceFileOutputFo...
View in text
Excerpt 5
0000000020 in the preceding example), and it is flushed and synced after every transaction before a success code is returned to the client. For namenodes tha...
View in text
Excerpt 6
guration object by calling the setSchema() static method on GroupWriteSupport, and then the Configuration object is passed to ParquetWriter. This example als...
View in text
Excerpt 7
pter 19) were both under development at the time of writing. Both promise significant performance gains over MapReduce mode, so try them if they are availabl...
View in text
Excerpt 8
the table metadata, ALTER TABLE moves the underlying table directory so that it reflects the new name. In the current example, /user/hive/warehouse/source is...
View in text
Tags
AI categories
AI
ISBN: 1491901632
Publisher: O'Reilly Media
Publish Year: 2015
Language: English
Pages: 768
File Format: PDF
File Size: 11.1 MB
Text Preview (First 20 pages)
Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Generating text preview…