Microsoft is integrating Apache Spark more tightly in SQL Server 2019. Microsoft provides an integrated analytics platform to provide AI (artificial intelligence) services directly in SQL Server. SQL Server 2019 integrates HDFS (Hadoop file system), Spark, Knox, Ranger, and Livy.