These include the ability to copy data into Iceberg tables using a newly supported SQL command, COPY INTO support for consolidating multiple files into one, using the new OPTIMIZE command in Dremio Sonar (which will also now federate across more data sources) and the addition of a new ROLLBACK command to return a table to a previous specific time or snapshot ID. At its Subsurface event on March 1, data lake/lakehouse player Dremio announced a number of enhancements to its support for the Iceberg table format. To illustrate these trends, let’s start in the world of data lakes and lakehouses, where the open source Apache Parquet file format, and its derivatives, like Apache Iceberg and Delta Lake, continue to gain momentum. So, let’s take a look at announcements from eight different vendors, over just the last few weeks, and analyze what, when taken together, they mean for the industry. The increased criticality and standardization of data lake technology, the continuing importance of AI and machine learning, additional momentum for doing analytics in the cloud, the ongoing relevance of data integration, and embedding of analytics technologies into mainstream productivity and developer tools, all play a role in the news. As complicated as the analytics landscape can be, it’s starting to feel like important ideas and standards are asserting themselves and gaining widespread adoption. Together, they point to some important trends in the industry as it wraps up its first quarter of the 2023 calendar year. In the last few weeks, there has been a glut of news from many of the major players, new and old, in the analytics space.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |