Different Fields for Data Science

Data science, also known as data-driven science, is an interdisciplinary field about scientific methods, processes and systems to extract knowledge or insights from data in various forms, either structured or unstructured,similar to Knowledge Discovery in Databases (KDD).
Data science is a "concept to unify statistics, data analysis and their related methods" in order to "understand and analyze actual phenomena" with data. It employs techniques and theories drawn from many fields within the broad areas of mathematics, statistics, information science, and computer science, in particular from the subdomains of machine learning, classification, cluster analysis, data mining, databases, and visualization.

Turing award winner Jim Gray imagined data science as a "fourth paradigm" of science (empirical, theoretical, computational and now data-driven) and asserted that "everything about science is changing because of the impact of information technology" and the data deluge.
When Harvard Business Review titled "The Sexiest Job of the 21st Century" the term became a buzzword, and is now often applied to business analytics, or even arbitrary use of data, or used as a sexed-up term for statistics. While many university programs now offer a data science degree, there exists no consensus on a definition or curriculum contents. Because of the current popularity of this term, there is a lot of "advocacy efforts" surrounding it.



Fig 1: Different fields for Data Science


1. Statistics: Statistics techniques are needed to explore data and answer questions from the data by finding common patterns. Some examples include the ability to create predictive models (ex: who is most likely to win the NCAA basketball championship?), cluster groups of information (ex: what types of shoppers are there?), and detect anomalies (ex: which bank transactions are untypical?). 


2. Computer Science: Computer Science techniques are needed for most backend processes involved in Data Science. This includes knowing which technologies to use to ingest, process, and manage data. This also includes understanding how to scale systems as data grows and where to apply various algorithms for the best computational efficiency. For example, say you work for a bank and have identified a common pattern in the data for fraudulent transactions using statistical techniques. Now you want to take those techniques and apply them to all your customers (future and current) on an ongoing basis. Computer Science techniques will help you do this. 


3. Communication: Being able to get to results is one thing. If you are unable to demonstrate to stakeholders why your results are important or what they mean, your analysis will do little to nothing for the business. Communicating results goes beyond basic communication skills and public speaking. It includes building practical models (even if it's not the 'best' model), and visualizing your results. A sub-category of Communication might also be Business. You need to understand the bigger picture of why you are doing what you are doing. There are many Data Scientists that can do really cool complex things, but few that recognize the simple practical solution that may be sitting right in front of them.

Comments

Post a Comment

Popular posts from this blog

Analysis and Research trends using Word Co-occurrence Network

Image
Co-occurrence networks   are basically used to provide and give a graphic visualization of potential relationships between people, community, organizations, concepts or other entities represented within the form of written material. The generation and visualization of   co-occurrence   networks has become practical with the advent of electronically stored and save the text amenable to   text mining . By way of definition, co-occurrence networks are the collective interconnection of terms based on their paired presence within a specified unit of text. Networks are generated by connecting pairs of terms using a set of criteria defining co-occurrence. For example, terms A and B may be said to “co-occur” if they both appear in a particular article. Another article may contain terms B and C. Linking A to B and B to C creates a co-occurrence network of these three terms. Rules to define co-occurrence within a   text corpus   can be set according to desired criteria. For example, more str
Read more

Significance of Woman in Data Science

Image
Research scientists, regardless of gender, are doing great in this field. This has been evidenced by a great conference " Global Women in Data Science " hosted by Stanford University (livestream) for 75+ locations all over the world on 3rd February 2017. Many talented academic researchers and practitioners have successful connected to make their dreams and goals burst into reality. It has been sponsored by Microsoft, Google, WalmartLabs, SAP and many more A Grade firms.  Fig 1: Global Women in Data Science Another great initiative, Women in Machine Learning   has been hosted on Facebook. Many female potential researchers join hands for research in machine learning. Many of them have achieved great milestones and many are still on the way.  The world is full of talented, successful and fantastic female speakers Women in Machine Learning and Data science are often un-noticable by traditional recruiters and we can turn it down. Another initiative at Meetup.c
Read more

Different types of clustering for textual documents

Clustering Model 1: Nearest Neighbour Algorithms: KD-Trees and Locality Sensitive Hashing Core Machine Learning Concepts: Distance Metrics and Approximation Algorithms Problem Domain: Finding similar documents Nearest neighbour: Find distance between all other documents and query document. Retrieve the document which is closest Critical Component Document Representation Computing Distances Scaling to large dataset: KD Trees - Not appropriate for very high dimensional documents Thus, Locality sensitive hashing is used for approximate nearest neighbour search. Clustering Model 2: Capturing uncertainty in clustering: Mixture Models Any document can be related to t i topic by x%. Can learn users topic preferences Making soft assignments to clusters -Expectation Maximization Clustering Model 3: Latent dirichlet allocation Mixed membership Probability of words in vocabulary Unsupervised learning task
Read more