Details

Modern Big Data Architectures


Modern Big Data Architectures

A Multi-Agent Systems Perspective
1. Aufl.

von: Dominik Ryzko

41,99 €

Verlag: Wiley
Format: EPUB
Veröffentl.: 09.04.2020
ISBN/EAN: 9781119597933
Sprache: englisch
Anzahl Seiten: 208

DRM-geschütztes eBook, Sie benötigen z.B. Adobe Digital Editions und eine Adobe ID zum Lesen.

Beschreibungen

<p><b>Provides an up-to-date analysis of big data and multi-agent systems</b></p> <p>The term Big Data refers to the cases, where data sets are too large or too complex for traditional data-processing software. With the spread of new concepts such as Edge Computing or the Internet of Things, production, processing and consumption of this data becomes more and more distributed. As a result, applications increasingly require multiple agents that can work together. A multi-agent system (MAS) is a self-organized computer system that comprises multiple intelligent agents interacting to solve problems that are beyond the capacities of individual agents. <i>Modern Big Data Architectures </i>examines modern concepts and architecture for Big Data processing and analytics.</p> <p>This unique, up-to-date volume provides joint analysis of big data and multi-agent systems, with emphasis on distributed, intelligent processing of very large data sets. Each chapter contains practical examples and detailed solutions suitable for a wide variety of applications. The author, an internationally-recognized expert in Big Data and distributed Artificial Intelligence, demonstrates how base concepts such as agent, actor, and micro-service have reached a point of convergence—enabling next generation systems to be built by incorporating the best aspects of the field. This book:</p> <ul> <li>Illustrates how data sets are produced and how they can be utilized in various areas of industry and science</li> <li>Explains how to apply common computational models and state-of-the-art architectures to process Big Data tasks</li> <li>Discusses current and emerging Big Data applications of Artificial Intelligence</li> </ul> <p><i>Modern Big Data Architectures: A Multi-Agent Systems Perspective </i>is a timely and important resource for data science professionals and students involved in Big Data analytics, and machine and artificial learning. </p>
<p>List of Figures ix</p> <p>List of Tables xi</p> <p>Preface xiii</p> <p>Acknowledgments xv</p> <p>Acronyms xvii</p> <p><b>Chapter 1 Introduction 1</b></p> <p>1.1 Motivation 1</p> <p>1.2 Assumptions 3</p> <p>1.3 For Whom is This Book? 4</p> <p>1.4 Book Structure 4</p> <p><b>Chapter 2 Evolution of IT Architectures and Paradigms 7</b></p> <p>2.1 Evolution of IT Architectures 7</p> <p>2.1.1 Monolith 7</p> <p>2.1.2 Service Oriented Architecture 9</p> <p>2.1.3 Microservices 12</p> <p>2.2 Actors and Agents 15</p> <p>2.2.1 Actors 15</p> <p>2.2.2 Agents 17</p> <p>2.3 From ACID to BASE, CAP, and NoSQL – The Database (R)evolution 22</p> <p>2.4 The Cloud 24</p> <p>2.5 From Distributed Sensor Networks to the Internet of Things and Cyber-Physical Systems 27</p> <p>2.6 The Rise of Big Data 28</p> <p><b>Chapter 3 Sources of Data 31</b></p> <p>3.1 The Internet 32</p> <p>3.1.1 The Semantic Web 32</p> <p>3.1.2 Linked Data 35</p> <p>3.1.3 Knowledge Graphs 36</p> <p>3.1.4 Social Media 38</p> <p>3.1.5 Web Mining 38</p> <p>3.2 Scientific Data 40</p> <p>3.2.1 Biomedical Data 40</p> <p>3.2.2 Physics and Astrophysics Data 41</p> <p>3.2.3 Environmental Sciences 44</p> <p>3.3 Industrial Data 45</p> <p>3.3.1 Smart Factories 45</p> <p>3.3.2 SmartGrid 47</p> <p>3.3.3 Aviation 47</p> <p>3.4 Internet of Things 48</p> <p><b>Chapter 4 Big Data Tasks 51</b></p> <p>4.1 Recommender Systems 51</p> <p>4.2 Search 52</p> <p>4.3 Ad-tech and RTB Algorithms 55</p> <p>4.4 Cross-Device Graph Generation 57</p> <p>4.5 Forecasting and Prediction Systems 58</p> <p>4.6 Social Media Big Data 59</p> <p>4.7 Anomaly and Fraud Detection 61</p> <p>4.8 New Drug Discovery 63</p> <p>4.9 Smart Grid Control and Monitoring 64</p> <p>4.10 IoT and Big Data Applications 65</p> <p><b>Chapter 5 Cloud Computing 67</b></p> <p>5.1 Cloud Enabled Architectures 67</p> <p>5.1.1 Cloud Management Platforms 67</p> <p>5.1.2 Efficient Cloud Computing 73</p> <p>5.1.3 Distributed Storage Systems 75</p> <p>5.2 Agents and the Cloud 82</p> <p>5.2.1 Multi-agent Versus Cloud Paradigms 83</p> <p>5.2.2 Agents in the Cloud 83</p> <p><b>Chapter 6 Big Data Architectures 87</b></p> <p>6.1 Big Data Computation Models 87</p> <p>6.1.1 MapReduce 87</p> <p>6.1.2 Directed Acyclic Graph Models 89</p> <p>6.1.3 All-Pairs 92</p> <p>6.1.4 Very Large Bitmap Operations 93</p> <p>6.1.5 Message Passing Interface 94</p> <p>6.1.6 Graphical Processing Unit Computing 95</p> <p>6.2 Publish-Subscribe Systems 97</p> <p>6.3 Stream Processing 99</p> <p>6.3.1 Information Flow Processing Concepts 99</p> <p>6.3.2 Stream Processing Systems 101</p> <p>6.4 Higer Level Big Data Architectures 110</p> <p>6.4.1 Spark 110</p> <p>6.4.2 Lambda 112</p> <p>6.4.3 Multi-Agent View of the Lambda Architecture 113</p> <p>6.4.4 Questioning the Lambda 115</p> <p>6.5 Industry and Other Approaches 116</p> <p>6.6 Actor and Agent-Based Big Data Architectures 118</p> <p><b>Chapter 7 Big Data Analytics, Mining, and Machine Learning 121</b></p> <p>7.1 To SQL or Not to SQL 122</p> <p>7.1.1 SQL Hadoop Interfaces 123</p> <p>7.1.2 From Shark to SparkSQL 125</p> <p>7.2 Big Data Mining and Machine Learning 128</p> <p>7.2.1 Graph Mining 133</p> <p>7.2.2 Agent Based Machine Learning and Data Mining 134</p> <p><b>Chapter 8 Physically Distributed Systems – Mobile Cloud, Internet of Things, Edge Computing 137</b></p> <p>8.1 Mobile Cloud 138</p> <p>8.2 Edge and Fog Computing 145</p> <p>8.2.1 Business Case: Mobile Context Aware Recommender System 147</p> <p>8.3 Internet of Things 148</p> <p>8.3.1 IoT Fundamentals 148</p> <p>8.3.2 IoT and the Cloud 151</p> <p>8.3.3 MAS in IoT 156</p> <p><b>Chapter 9 Summary 159</b></p> <p>Bibliography 161</p> <p>Index 179</p>
<p><b>DOMINIK RYŻKO</b> is an Assistant Professor at the Institute of Computer Science at Warsaw University of Technology. His research interests include Big Data and Distributed Artificial Intelligence. He is widely published, serves on program committees at international conferences, and is Vice President of artificial intelligence and analytics at Adform, a global ad-tech platform provider. He also spent three years at Allegro Group as the Chief Data Scientist where he oversaw Data Science activities, design and methodology of experiments, and model building.
<p><b>Implement adaptive systems for Big Data processing using next-generation concepts</b> <p>As artificial intelligence technology advances, so does our ability to solve complex problems by analyzing Big Data. <i>Modern Big Data Architectures</i> offers a look into the future of Big Data, underscoring the untapped potential of the multi-agent systems (MAS) view. <p>Author Dominik Ryżko, an international expert on processing massive datasets using distributed AI, shows how multiple autonomous AI "agents" can work collaboratively to solve Big Data problems too complex, too difficult, or too large for a typical monolithic system. Considering how the MAS paradigm can improve our current approaches to Big Data, this book covers: <ul> <li>Agent-based (and non-agent-based) methods of producing Big Data sets</li> <li>Key Big Data applications, from product recommendations to drug discovery</li> <li>Traditional and next-generation Big Data architectures</li> <li>Data mining, machine learning, and SQL analytics using the MAS approach</li> <li>Big Data and agents in cloud computing, fog computing, and Internet of Things</li> </ul> <p>Researchers and practitioners alike in the fields of Big Data, analytics, machine learning, cloud computing, and distributed AI will discover new ideas in <i>Modern Big Data Architectures.</i>

Diese Produkte könnten Sie auch interessieren:

MDX Solutions
MDX Solutions
von: George Spofford, Sivakumar Harinath, Christopher Webb, Dylan Hai Huang, Francesco Civardi
PDF ebook
53,99 €
Concept Data Analysis
Concept Data Analysis
von: Claudio Carpineto, Giovanni Romano
PDF ebook
107,99 €
Handbook of Virtual Humans
Handbook of Virtual Humans
von: Nadia Magnenat-Thalmann, Daniel Thalmann
PDF ebook
150,99 €