How We Improved Spark Jobs on HDFS Up To 30 Times - Unmasp - experience exhibiting blog

Post Top Ad

Post Top Ad

Hacker Noontech

How We Improved Spark Jobs on HDFS Up To 30 Times

As the third largest e-commerce site in China, Vipshop processes large amounts of data collected daily to generate targeted advertisements for its consumers. In this article, guest author Gang Deng from Vipshop describes how to meet SLAs by improving struggling Spark jobs on HDFS by up to 30x, and optimize hot data access with Alluxio to create a reliable and stable computation pipeline for e-commerce targeted advertising.

Read the full story



from Hacker Noon https://ift.tt/3iaOJth

Related Posts

No comments:

Post a Comment

Post Bottom Ad