Apache Spark is an open source framework developed by AMPlab and then donated to the Apache Foundation. It’s used for data analysis and it’s part of a wider set of tools that includes Apache Hadoop and the Hadoop Distributed File System. One of the main applications is in the implementation of Artificial Intelligence, specifically for automated learning algorithms, thanks to the speed of data transfer and consultation.
The available version is 1.6.0 (beginning of 2016), actually.