BIG DATA IN DIGITS
One of the fundamental reasons for the existence of the big data phenomenon is the current extent to which information can be generated and made available [5]. The speed growth of data, especially those approved by intelligent objects, will reach more than 50 billion in the world in 2020. According to predictions, 40,000 billion data will be generated [14].
It is estimated that 90% of the data collected since the beginning of humanity have been generated only over the last two years, in which 70% of the data are created by individuals, although it is the companies that store and manage 80% of it.
Following this exponential trend in data, the countries became aware of the importance of big data, and thus in 2012, the U.S. announced a donation of 200 million dollars for research related to the theme of big data. In parallel, the big data strategy generates profits of S8.9 billion, which is the revenue generated by the big data market in 2014. Certainly, Amazon would generate 30% of its revenues through cross-selling [12].
1.3.1 BIG DATA ORIGIN
According to Fermigier [6], big data comes in particular from:
- • The Web: Access logs, social networks, e-commerce, indexing, storage of documents, photos, videos, linked data, etc. (e.g., Google processed 24 petabytes of data per day with MapReduce in 2009).
- • The Internet and Connected Objects: RFID, sensor networks, telephone call logs.
- • Science: Genomics, astronomy, subatomic physics (e.g., the German Climate Research Centre manages a database of 60 petabytes).
- • Business: e.g., Transaction history in a chain of hypermarkets.
- • Personal Data: e.g., Medical records.
- • Public Data: Open data.
- 1.3.2 BIG DATA PIONEERS
The massive growth of new big data technologies has become essential for many companies wishing to better know their suppliers and customers. The booming big data market includes several actors offering specific services
[TI-
Major web stakeholders, including Yahoo and Google search engines, as well as social media such as Facebook, also offer big data solutions. From 2004, Google proposed MapReduce, an algorithm capable of processing and storing a large amount of data. In 2014, Google announced its replacement by Google Cloud Dataflow, a SaaS solution.
Yahoo, for its part, is one of the main contributors to the Hadoop project by hiring Doug Cutting, its creator. The search engine has also created Horton works, a company dedicated entirely to the development of Hadoop.
Amazon, the American online retail giant, is also one of the pioneers of big data. Since 2009, it has provided companies with tools such as Amazon
Web Services (AWS) and Elastic MapReduce, better known as EMR. The latter is accessible to everyone since its use does not require any skill in installing and adjusting Hadoop clusters [8].
Everyday users and individuals produce a massive amount of data. This data presents many opportunities for companies. Big data is the largest volume of data that translates into the creation of new technology that facilitates the growth and development of big data, which can be broadly categorized into two main families.
On the one hand, storage technologies are driven particularly by the deployment of cloud computing. On the other hand, the arrival of adjusted processing technology, especially the development of new databases adapted to unstructured data (Hadoop) and the implementation of high-performance computing modes (MapReduce). Figure 1.2 summarizes the main technologies that support the deployment of big data.
FIGURE 1.2 Big data technology.
