Distributed Data Management (WT 2019/20) - tele-TASK
The free lunch is over! Computer systems up until the turn of the century became constantly faster without any particular effort simply because the hardware they were running on increased its clock speed with every new release. This trend has changed and today's CPUs stall at around 3 GHz. The size of modern computer systems in terms of contained transistors (cores in CPUs/GPUs, CPUs/GPUs in compute nodes, compute nodes in clusters), however, still increases constantly. This caused a paradigm shift in writing software: instead of optimizing code for a single thread, applications now need to solve their given tasks in parallel in order to expect noticeable performance gains. Distributed computing, i.e., the distribution of work on (potentially) physically isolated compute nodes is the most extreme method of parallelization.Big Data Analytics is a multi-million dollar market that grows constantly! Data and the ability to control and use it is the most valuable ability of today's computer systems. Because data volumes grow so rapidly and with them the complexity of questions they should answer, data analytics, i.e., the ability of extracting any kind of information from the data becomes increasingly difficult. As data analytics systems cannot hope for their hardware getting any faster to cope with performance problems, they need to embrace new software trends that let their performance scale with the still increasing number of processing elements.
In this lecture, we take a look a various technologies involved in building distributed, data-intensive systems. We discuss theoretical concepts (data models, encoding, replication, ...) as well as some of their practical implementations (Akka, MapReduce, Spark, ...). Since workload distribution is a concept which is useful for many applications, we focus in particular on data analytics. www.tele-task.de

馃帶 Podcast episodes
Listen to 27 episodes


























Similar podcasts
CLINICAL DATA MANAGEMENT
It is Clinical Data Management Best Practices podcast by IBA. Scientists need professional Data managers and Tools to be able to make the right decisions and establish their hypotheses correctly. We bring you interviews with leading specialists in Data Management, Biotechnology,...
All Call with Task Force 20
A podcast by veterans, discussing veteran topics. Podcast led by the nonprofit executive board of Task Force 20.https://linktr.ee/taskforce20?utm_source=linktree_profile_share<sid=9015754e-3932-46ab-88c1-4bbfc480c4ae
20/20
Unforgettable true crime mysteries, exclusive newsmaker interviews, hard-hitting investigative reports and in-depth coverage of high profile stories.
Reshaping Education - Online Education, Cohort-based Courses, Bootcamps, and More
Reshaping Education is a podcast all about the future of learning including bootcamps, online courses, and how the internet is changing how we learn. Guests include top "edupreneuers," including:
- Michael Chasen (Co-Founder & CEO, Class.com, prev: Blackboard)
- Austen Allred (F...
RegTech 20/20
Launched in 2020, the RegTech 20:20 podcast from Encompass gives a 360 view of RegTech industry, bringing the issues that really matter in regulatory compliance and technology into focus.
We speak to industry experts and commentators to answer the questions you have about RegTec...
Maryland Risk Management Education Podcast
Podcast geared towards discussing crop insurance, risk management education, farm policy, and agricultural and food law issues facing Maryland agriculture. Any images you see are by Edwin Remsberg unless otherwise noted.
EMS 20/20
EMS 20/20 is podcast hosted by two experienced Paramedics. Spencer Oliver and Christopher Pfingsten discuss real calls run by real responders and pull out the lessons you won't find in a text book. This podcast is aimed at Paramedic students, seasoned Paramedics looking to refres...
20/20 MONEY
20/20 MONEY, hosted by Certified Financial Planner and experienced Wealth Adviser Adam Cmejla, aims to bring clarity to financial concepts and strategies that impact optometrists.
For more information on the show and on Adam, please visit https://www.integratedpwm.com/