SQL到Hadoop和回来,第3部分:直接传输和实时数据交换
SQL to Hadoop and back again, Part 3: Direct transferand live data exchange
关键词:直接传输;数据交换;实时;大数据
摘 要:Big data is a term that has been used regularly now for almost a decade, and it — alongwith technologies like NoSQL — are seen as the replacements for the long-successfulRDBMS solutions that use SQL. Today, DB2?, Oracle, Microsoft? SQL Server MySQL, andPostgreSQL dominate the SQL space and still make up a considerable proportion of the overallmarket. In this final article of the series, we will look at more automated solutions for migratingdata to and from Hadoop. In the previous articles, we concentrated on methods that takeexports or otherwise formatted and extracted data from your SQL source, load that into Hadoopin some way, then process or parse it. But if you want to analyze big data, you probably don'twant to wait while exporting the data. Here, we're going to look at some methods and tools thatenable a live transfer of data between your SQL and Hadoop environments.