ipl-logo

The Pros And Cons Of Big Data

1907 Words8 Pages

Abstract
The advent of social networking and Internet of Things has resulted in an exponential increase in the volume of data. Simultaneously, the need to process and analyze the large volumes of data for business decision making has also increased. Many business and scientific applications need to process petabytes of data in efficient manner on daily basis. This data is categorized as "Big Data" due to its sheer Volume, Variety and Velocity and has resulted in a problem for the industry due to the inability of conventional database systems and software tools to manage and to process the big data sets within tolerable time limits. The scale, diversity, and complexity of Big Data require new architecture, techniques and algorithms to manage …show more content…

Gaining critical business insights by querying and analyzing such a very big amounts of data is suitable need of the hour and become a challenge to the standard data taking out approach. This data comes from a broad range of sources such as logs, social communication, sensors etc. The organizations are facing new challenges to analyze vast amounts of information. The different aspects of the big data make it difficult to manage. Big data requires speed for its processing. It requires fast information retrieval techniques that can retrieve data from this huge amount. Four V’s that are used to explain Big data’s complexity …show more content…

Limitations of Traditional Databases to support Big Data

Traditional Databases are not suitable for Big Data because of so many reasons. Some of them are listed below:

Traditional Databases –

- Finds it challenging to handle such huge data volumes
- The majority of the data comes in a semi-structured or unstructured format from social media, audio, video, texts, and emails. Traditional databases can’t categorize unstructured data. They are designed to accommodate structured data.
- Traditional Databases lack in high velocity because these are designed for steady data retention rather than rapid growth
- Even if traditional databases are used to store and process big data it will turn out to be very expensive.

So, Big data requires exceptional technologies to efficiently process large quantities of data within tolerable time limits. Technologies being applied to big data include massively parallel processing databases, distributed file system, distributed databases, cloud computing platforms, the mining grids, the Internet and scalable storage systems. Real time or near-real time information delivery is one of the defining characteristics of Big Data analytics.

2. Hadoop: Solution for Big data

Show More
Related

  • Nt1330 Unit 12 Research Paper

    826 Words  | 4 Pages

    Hadoop [8] is an open source implementation of MapReduce programming model which runs in a distributed environment. Hadoop consists of two core components namely Hadoop Distributed File System (HDFS) and the MapReduce programming with the job management framework. HDFS and MapReduce both follow the master-slave architecture. A Hadoop program (client) submits a job to the MapReduce framework through the jobtracker which is running on the master node. The jobtracker assigns the tasks to the tasktrackers running on many slave nodes or on a cluster of machines.

    Read More

  • Pt1420 Unit 3 Problem Analysis Paper

    269 Words  | 2 Pages

    Hadoop MapReduce is a framework for processing large data sets in parallel across Hadoop cluster. It uses two steps Map and Reduce process. An initiated job has a map and reduces phases. The map phase counts the words in each document, then reduce phase aggregates the per document data into word counts spanning the entire collection. The reduce phase use the results from map tasks as input to a set of parallel reduce tasks and it consolidate the data into final result.

    Read More

  • Nt1310 Unit 3.4 Data Analysis

    2265 Words  | 10 Pages

    The data processing tasks for all the tools is Map Reduce and it is the Data processing tool which effectively used in the Big Data Analysis[13]. For handling the velocity and heterogeneity of data, tools like Hive, Pig and Mahout are used which are parts of Hadoop and HDFS framework. It is interesting to note that for all the tools used, Hadoop over HDFS is the underlying architecture. Oozie and EMR with Flume and Zoo keeper are used for handling the volume and veracity of data, which are standard Big Data management tools [13].

    Read More

  • Nt1320 Unit 3 Segression Analysis

    862 Words  | 4 Pages

    The simplest data searching algorithm is sequential search. In this method, we insert data into the tables in any order. In order to search for an entry in the table, we perform searching starting from the first element and perform the action sequentially until a matching entry is found or end of table is reached. In this case, the best-case performance is O(1), since matching entry is obtained in the first searching itself. However, the worst-case scenario occurs if the element to be searched is not in the table.

    Read More

  • The Pros And Cons Of The NSA

    1197 Words  | 5 Pages

    The National Security Agency also known as the NSA, it's an intelligent organization of the United States government who monitors foreign countries and collects information of people. The NSA is economically beneficial towards the government of the United States some reasons consist of the prevention of dangerous terrorist attacks, funding's in the government, and the prevention of hackers taking over the system. Though at the same time the NSA should be stopped because they have invaded the privacy of many people without their consents. Currently, the United States has been facing terrorist attack, which has caused many deaths and tragedies not only to the United States but as well towards the world.

    Read More

  • The Pros And Cons Of NSA Privacy

    842 Words  | 4 Pages

    Imagine for a second that every phone call you make, every text message you send, and every place you go is being constantly monitored by multiple governments. Well this is basically what the United State and United Kingdom's government is doing on a daily basis. The United States National Security Agency has been implementing projects in secret to monitoring people since 2001 but it would still be kept as a secret if Edward Snowden did not reveal this massive secret that was intruding the public’s privacy for years. The U.S. surveillance program started because of the September 9th, 2001 terrorist attack that hijacked airplanes and slammed them into the World Trade Center towers.

    Read More

  • Pros And Cons Of The Patriot Act

    345 Words  | 2 Pages

    The Act was designed to preserve the safety of America from any other terrorist attacks and to not allow another ambush to happen within the United States. After the aggression which took place on September 11th, 2001, there was a great fear in the American people. The ratification of the Patriot Act was the government’s approach of trying to prevent any forms of terrorism in our country. Another positive that thing that came with the Patriot Act was the recognition of technology and how technology usage is growing at a rapid pace.

    Read More

  • Nt1330 Unit 2.7 Observation Paper

    500 Words  | 2 Pages

    Therefore, the database can be any type such as SQL, Not Only SQL (NOSQL), or other. Observation_4: The CSP needs to apply a virtualization technology on storage resources to serve CSUs’ demands efficiently. Therefore, a

    Read More

  • Big Data In Human Resource Management

    975 Words  | 4 Pages

    Even though organizations hold huge amount of data, they cannot use them effectively as they are unstructured. However new technologies are now available which enable analysis of large, complex, unstructured data. The accessibility of technology has become easy; as a result, there is massive increase in data amounts available with the entrepreneurs. The data usage depends on the ability the way it is stored, managed and then analyzing it adequately. Big data is an upcoming and emerging trend in the field of Information technology.

    Read More

  • Nt1330 Unit 6 Exercise 1

    433 Words  | 2 Pages

    Each worker can access the shared drive on the network to look at the job configuration. After the workers have finished computing the client can access the output from the shared drive. Scheduler Architecture: There are independent queues for managing the job efficiently, when the job is submitted initially it moves to the pending queue, from the pending queue it is submitted to the queued queue where it stays for some time until the server can begin to compute it. Then when the server is ready to send tasks to the workers it can or has already created it accepts the job keeps it in the running queue where each job is submitted to a worker. Further proposed optimizations on the Model: Multiple schedulers can be incorporated at the server that can spin up their own individual Virtual Machines as their workers.

    Read More

  • Predictive Analytics Essay

    942 Words  | 4 Pages

    As big data things continue to grow in this modern era, today we can learn how to predict or assume anything that will happen in the future with data from the past. This studies known as Predictive Analytics. Predictive analytics combine methods from machine learning, data mining and statistics to find meaning or pattern from a huge volume of data. Tom H Davenport, a senior advisor at Deloitte Analytics has broken down three primer models on doing predictive analytics: the data, statistics, and assumptions.

    Read More

  • Coca Cola Unstructured Problem

    994 Words  | 4 Pages

    Tasting Success Article Page 95 Discussion Questions Question 1 Which decisions in this story could be considered unstructured problems? And structured problems? Structured problem Can be defined as a straightforward, familiar and easily defined issue, and it is easily solved by the eight step-by-step process Identify a Problem, Identify Decision Criteria, Allocate Weights to the Criteria, Develop Alternatives, Analyze Alternatives, Select an Alternative, Implement the Alternative and Evaluating Decision Effectiveness. The issue as described in the article is the orange juice production and it is considered as a structured problem, and the way it is produced, its mechanism is responsible for the production as it is based on Coca-Cola’s mixture

    Read More

  • Persuasive Essay On Information Technology

    949 Words  | 4 Pages

    Big Data There are many different definitions for Big Data. SAS (n.d.) an analytical software company describes it as, “a popular term used to describe the exponential growth and availability of data, both structured and unstructured.” Many think Big Data just came into existence but it has been around for years. Banks, retail, advertisers have been using big data for marketing purposes.

    Read More

  • Pros And Cons Of Social Media Analytics

    1261 Words  | 6 Pages

    Social Media Analytics and features It is the process of applying data (both structures as well as unstructured) from social media sites such as twitter, facebook, Google+ and other such sites for better understanding of customer attitude and behavior. It also serve as an effective tool for business and market research and ultimately for business decision making. The large availability of user-generated data and the links between users leads to the dispersion of useful information, opinions and sentiment as well as emergent issues and trends (Leskovec 2011; Agrawal et al. 2011; Nagarajan et al. 2011) and is referred to as ‘Social Media Analytics’.

    Read More

  • Advantages And Disadvantages Of Relational Database Management System

    1110 Words  | 5 Pages

    As compared to other databases this database has a slow extraction of results thus making it a slower database. 2. Memory space: The database uses tables having rows and columns which consumes a lot of physical memory which becomes a disadvantage of the database. P a g e 2 | 5 3.

    Read More

More about The Pros And Cons Of Big Data

Open Document