Pro Spark Streaming

Author: Zubair Nabi
Publisher: Apress
ISBN: 148421479X
Size: 62.78 MB
Format: PDF
View: 6491
Download
Learn the right cutting-edge skills and knowledge to leverage Spark Streaming to implement a wide array of real-time, streaming applications. This book walks you through end-to-end real-time application development using real-world applications, data, and code. Taking an application-first approach, each chapter introduces use cases from a specific industry and uses publicly available datasets from that domain to unravel the intricacies of production-grade design and implementation. The domains covered in Pro Spark Streaming include social media, the sharing economy, finance, online advertising, telecommunication, and IoT. In the last few years, Spark has become synonymous with big data processing. DStreams enhance the underlying Spark processing engine to support streaming analysis with a novel micro-batch processing model. Pro Spark Streaming by Zubair Nabi will enable you to become a specialist of latency sensitive applications by leveraging the key features of DStreams, micro-batch processing, and functional programming. To this end, the book includes ready-to-deploy examples and actual code. Pro Spark Streaming will act as the bible of Spark Streaming. What You'll Learn Discover Spark Streaming application development and best practices Work with the low-level details of discretized streams Optimize production-grade deployments of Spark Streaming via configuration recipes and instrumentation using Graphite, collectd, and Nagios Ingest data from disparate sources including MQTT, Flume, Kafka, Twitter, and a custom HTTP receiver Integrate and couple with HBase, Cassandra, and Redis Take advantage of design patterns for side-effects and maintaining state across the Spark Streaming micro-batch model Implement real-time and scalable ETL using data frames, SparkSQL, Hive, and SparkR Use streaming machine learning, predictive analytics, and recommendations Mesh batch processing with stream processing via the Lambda architecture Who This Book Is For Data scientists, big data experts, BI analysts, and data architects.

Untersuchung Und Bewertung Cloud Basierter Streaming Technologien Zur Echtzeit Datenanalyse

Author: Christian Voigtländer
Publisher: diplom.de
ISBN: 3961162271
Size: 27.85 MB
Format: PDF, Docs
View: 1714
Download
Das Internet sorgt für ein rasches Wachstum von verfügbaren Daten. Dem „EMC/IDC Digital Universe“ Report nach verdoppelt sich die Menge an Daten alle zwei Jahre. Es werden täglich eine Millionen Uber-Fahrten gebucht, monatlich 10 Milliarden Stunden Netflix-Videos konsumiert und jährlich eine Trillion US-Dollar auf E-Commerce-Webseiten ausgegeben. Dabei spielt der Umgang mit diesen Daten eine große Rolle für den Erfolg dieser Unternehmen. Insbesondere die Echtzeit-Datenanalyse hilft den Unternehmen, Kundenwünsche schnellstmöglich zu erkennen und diese auszuschöpfen. Ein weiterer Faktor des immensen Datenwachstums sind Web 2.0 Plattformen. In diesem Bereich sind die Benutzer der treibende Faktor für die stetig wachsende Datenflut dieser Plattformen, indem sie Beiträge veröffentlichen, Fotos teilen und Videos streamen. Beispielsweise sammelt Twitter 8 Terabyte, Facebook 500 Terabyte und Google 20 Terabyte an benutzergenerierten Daten täglich. Inhalte sind nicht länger statisch, sondern dynamisch. Diese Datenflut gilt es, zu kontrollieren. Unmittelbar nachdem Daten entstehen, haben sie den höchsten Wert. In der heutigen Zeit wird erwartet, Ergebnisse in schnellstmöglicher Zeit bereitzustellen. Analytische Prozesse werden in Minuten, Sekunden oder Bruchteilen von Sekunden durchgeführt, welche früher Monate, Tage oder Stunden gebraucht hätten. Aufgrund dieser Evolution der stetig neu entstehenden Daten müssen Veränderungen in der Art und Weise, wie diese Daten empfangen, transportiert, verarbeitet und analysiert werden, stattfinden. Die Technologie, die Echtzeit-Datenanalysen durchführt, wird in der vorliegenden Arbeit genauer betrachtet.

A Princess Of Mars

Author: Edgar Rice Burroughs
Publisher: Createspace Independent Publishing Platform
ISBN: 9781518867699
Size: 21.72 MB
Format: PDF, Docs
View: 588
Download

Big Data T Cnicas E Tecnologias Para Extra O De Valor Dos Dados

Author: Rosangela Marquesone
Publisher: Editora Casa do Código
ISBN: 8555192323
Size: 76.43 MB
Format: PDF, ePub, Mobi
View: 911
Download
Estamos na era dos dados. Não importa qual seja a sua área de atuação, uma palavra atualmente em evidência é: Big Data. Podemos encontrar casos de uso em que esse conceito permitiu a redução do número de fraudes, redução de custos na produção, eficiência energética, aumento de segurança, entre outros benefícios tão almejados em diversos domínios. Muito embora o interesse esteja em alta, Big Data ainda é um termo incipiente, gerando incertezas sobre sua definição, características, aplicabilidade e desafios. Como obter dados de diferentes fontes? Como extrair valor a partir dos dados? Qual a infraestrutura necessária para criar uma solução de Big Data? Quais habilidades são necessárias para atuar com Big Data em seu projeto? Neste livro, Rosangela Marquesone apresenta as tecnologias e soluções de Big Data, em uma abordagem conceitual que detalha as características e capacidades de cada uma delas. Você verá as principais fases de um projeto de Big Data, desde a captura, o armazenamento, o processamento, análise, até a visualização de dados. Para mais livros, acesse http://www.casadocodigo.com.br

Around The World In 80 Days

Author: Jules Verne
Publisher: Castrovilli Giuseppe
ISBN: 9781612980461
Size: 29.98 MB
Format: PDF, ePub
View: 3292
Download
The fantastic journey of Phileas Fogg and his faithful manservant Passepartout has thrilled millions of readers. It's the strangest and most exotic challenge a man ever met an adventure that soars through London, Paris, Hong Kong, India, and the wild American West. - Back cover