Abstract:- This paper presents a brief idea about data mining, data mining technology, and big data. The applications regarding data mining will also be discussed briefly. The main cause of data mining is to get different ideas, how to access big data by different tools.
Keywords- data mining, data mining technology, big data.
I.INTRODUCTION Data mining refers to the use of data from big data source by using different tools in order to solve real time problems that include logistics management, scientific research, processing, financial decision making, retail, and medical research. The important use of data mining can increase the development in the information industry as well as providing benefits to the social cause In
…show more content…
Big data There is no proper definition of big data but after reading literature, The definition of big data tends to refer to the use of behavioral analytics and predictive analytics or other advanced data analytics methods to extract value from data.[1]
B. Data Mining Data mining is process of computing the data from the large data sets involving methods on to intersection of statistics, machine learning, and database systems. The basic goal of data mining is to get the data from large data sets in order to make it understandable structure for further use.[1]
C. Data mining technology Data mining technology helps the companies to understand the needs of customer’s or other different segmentations through a huge modeling data and mathematical model of companies mass data stream and analysis from the massive data.[1]
III. OVERVIEW OF DATA MINING
A. Development of data mining. In 1995, The first conference on knowledge Discovery and Data mining was held in Canada that was widely disseminated before this a huge amount of research was done by using artificial intelligence, machine learning and database technology for the discovery of
…show more content…
After 1993, KDD meeting was held once a year.the issues that were discussed in that conference were (1) Information of quantitative and qualitative knowledge: (2) Data dependence analysis: (3) Knowledge discovery: (4) Data analysis dependency: (5) The discovery of knowledge with applications of results: (6) Knowledge discovery system. But at end, data mining was core of knowledge discovery.[1]
B. Knowledge Discovery of Data Mining. The combinational development of databases and AI machines that bring the new technology called as discovery in databases, The overall fields of science that discover machine learning, data visualization, knowledge recognition, computing on high performance, and expert systems but the main thing in it is data selection, data pre-processing, data converting, data mining explanation and evolution of knowledge while the data mining is the steps of knowledge discovering and is the most important one.[2]
IV. LITERATURE SURVEY
A. Data Mining Based Intrusion
Big Data is characterized by four key components, volume, velocity, variety, and value. Furthermore, Big Data can come from an array sources such as Facebook, Twitter, call
The characteristics of this unstructured data are high in volume, high velocity, or high variety and complexity. Big data comes from sensors, devices, video/audio, networks, log files, transactional applications, web, and social media - much of it generated in real time and in a very large scale.
Customers are not easy to study and predict; they look around a lot before they can make a purchase on a product. There are over 200 million blogs online and 34% of the post opinions about products and brands, and 90% of consumers trust the opinions (HP Enterprise Business, 2012). With big data you can profile the trends and even engage in real-time conversation.
Big Data is a term used to refer to extremely large and complex data sets that have grown beyond the ability to manage and analyse them with traditional data processing tools. However, Big Data contains a lot of valuable information which if extracted successfully, it will help a lot for business, scientific research, to predict the upcoming epidemic and even determining traffic conditions in real time. Therefore, these data must be collected, organized, storage, search, sharing in a different way than usual. In this article, invite you and learn about Big Data, methods people use to exploit it and how it helps our life.
Big Data has gained massive importance in IT and Business today. A report recently published state that use of big data by a retailer could increase its operating margin by more than 60 percent and it also states that US health care sector could make more than $300 billion profit with the use of big data. There are many other sectors that could profit largely by proper analysis and usage of big data.
36 Ma Jian-guang,JIANG Wei, 2013 : The Concept,Characteristics and Application of Big Data pp 7-9
Attracting focus from firms in all industries, Big Data offers many benefits to those companies with the ability to harness its full potential. Firms using small data derive all of the data’s worth from its primary use, the purpose for which the data was initially collected. With Big Data, “data’s value shifts from its primary use towards its potential future uses” (Mayer-Schonberger & Cukier, 2013, p.99) thus leading to considerable increases in business efficiency. Employing Big Data analytics allows firms to increase their innovative capacity, and realize substantial cost reductions and time reductions. Moreover, Big Data techniques can be applied to support internal business decisions by identifying complex relationships within data. However, it is also important to recognize that much of Big Data’s value is “largely predicated on the public’s continued willingness to give data about themselves freely” (Brough, n.d., para. 11). As previously discussed, much of the content of Big Data is unstructured data from social media sites etc., and so if such data were to no longer be publically available due to regulation etc. the value of Big Data would be significantly diminished.
In today’s society, technology has become more advanced than the human’s mind. Companies want to make sure that their information systems stay up-to-date with the rapidly growing technology. It is very important to senior-level executives and board of directions of companies that their systems can produce the right and best information for their company to result in a greater outcome and new organizational capabilities. Big data and data analytics are one of those important factors that contribute to a successful company and their updated software and information systems.
Data mining has emerged as an important method to discover useful information, hidden patterns or rules from different types of datasets. Association rule mining is one of the dominating data mining technologies. Association rule mining is a process for finding associations or relations between data items or attributes in large datasets. Association rule is one of the most popular techniques and an important research issue in the area of data mining and knowledge discovery for many different purposes such as data analysis, decision support, patterns or correlations discovery on different types of datasets. Association rule mining has been proven to be a successful technique for extracting useful information from large datasets. Various algorithms or models were developed many of which have been applied in various application domains that include telecommunication networks, market analysis, risk management, inventory control and many others
There is a debate between the benefits and potential informational privacy issues in web-data mining. There are large amount of valuable data on the web, and those data can be retrieved easily by using search engine. When web-data mining techniques are applied on these data, we can get a large number of benefits. Web-data mining techniques are appealing to business companies for several reasons [1]. For example, if a company wants to expand its bu...
6- Developing of new tools, for all the new fields of studying, and developing programs for data mining and analysis of huge databases.
The dynamics of our society bring many challenges and opportunities to the business world. Within the last decade, hundreds of jobs have emerged particularly in the technology sector to help keep up with the ever-changing world and to compete on a larger and better scale than the competition. Two key job markets and the basis of this research paper are business intelligence or BI and data mining or DM. These two fields play a very important role in small to large companies and are becoming higher desired sectors within the back offices of the workplace. This paper will explore what the meaning of BI and DM really is, how they are used and what we can expect as workers and learners of the technology and business fields for the future.
Big data will then be defined as large collections of complex data which can either be structured or unstructured. Big data is difficult to notate and process due to its size and raw nature. The nature of this data makes it important for analyses of information or business functions and it creates value. According to Manyika, Chui et al. (2011: 1), “Big data is not defined by its capacity in terms of terabytes but it’s assumed that as technology progresses, the size of datasets that are considered as big data will increase”.
Adopting big data can also help the banking industry by saving them from lots of embarrassment resulting from increase in the number of customer which in turn requires banks to improve on their performance. As stated earlier banks are entrusted with lots of information and this information must be safe will be required to be accessed ready and in a timely fashion. The use a normal small database will not be enough to perform this operation and if banks don’t embrace the use of big data they might start to experience failure in there system.