Human Resources For Big Data Professions.

Kabita Parajuli
3 min readOct 7, 2022

--

A Systematic classification of job Roles and Required skill set

The term “big data analytics” has become popular among IT communities and scholars. Big Data has been popular in the industry in traditional concept as “Very Large DataBase” and “Data Mining” There is no certain definition of big data that results in the proliferation of multiple or contradictory definitions.

With the evolution and use of technologies “Big Data” refer to providing information or data to the right users at the right time with the right information from the mass of data that has been growing exponentially for a long time in our society. So in today’s world, the major challenge is not only to deal with the rapidly increasing volume of data but is to manage increasingly heterogeneous formats as well increasingly complex and interconnected data.

Many myths regarding big data lead people to think “big data is only for Big companies” or “big budgets, big teams, and the big platform is required to handle huge pools of data” but rather To run modern technologies and large data tools compaies need skilled data professionals. These professionals will include data scientists, data analytics, and data engineers to work with the tools and make sense of giant datasets. These jobs are categorized into different job families based on the terms and criteria:

Figure : Job Families selection based on role and responsibilities

Business Analyst : Business-facing Analysts, Project/Program Managers, Business Advicers

Bbusiness analyst focuses on transforming relevant insights into actual business impact and includes an element of organizational effectiveness. This field mentions responsibilities in the area of analytical business advisory and project management. Business analysts are the bridge between business decision-makers and more technical roles.

Data Scientists : Quantitative Analysts, Statisticians, Modelers.

Data scientists focus is on the data itself and the analytical methods for the transformation of data into insights. This job’s role includes the responsibility to identify the patterns apply context and intelligence extract relevant information hidden in the large volume of data, design and implement data models and statistical methods, and integrate research and best practices into problem avoidance. Data scientists need to know the business concept in which they operate and use project management techniques.

Developers : BI coders, Machine learning implementers

Big data Developers Focus to design, develop and modify data-reliant application software. The job description of this family is: Develop dashboard and data solutions, Design, build and deliver new reports, Prototypes working proof of concept for multi-threaded, multi-server applications. And the responsibility includes the Design, development, and implementation of automation innovations, Development of automated testing scripts.

System Managers : Architects, Infrastructure Admins

System managers focus on building and maintaining the full technology infrastructure. Roles of this family are responsible for — Managing the enterprise analytics server platform, Supporting all processes to load and manage the analytics data store, and integrating new data sources. The primary skill set relates to data architecture and includes the competencies needed to construct and manages the cooperate big data ecosystem.

Conclusion

There are different roles and responsibilities of the big data-related job in different job families and they focus on different categories. This provides a framework for Managers, recruiters, and strategic-level executives to think about job roles and skill to hire in big data jobs.

--

--

Kabita Parajuli

Computer Engineer | Data science and Analyts | Love to Learn Design and Program