Duties: Enable advanced business analytics with high volume data from various structured and unstructured sources. Implement distributed computing on large transactions of data records from consumer banking and consumer lending using Scala, Spark, Map Reduce, Hadoop, Hive, Oracle, Teradata, and Hbase. Responsible for data management, data analysis, feature creation for modeling, and understanding historical business patterns to support business analysis.. Define operational optimization to analyze complex real-world behavioral data to convert into measurable insights. Build data profiles to assess and ensure data quality to support internal corporate clients. Support other Data Scientists within Corporate Technology team by creating data features to detect anomalies across claims, applications, and related transactions. Build collaboration with other business partners, including architects and software developers, and assess product capabilities for improvements.
Minimum education and experience required: Bachelorâs degree or equivalent in Computer Science, or related field, plus 5 years of large scale data processing experience with distributed computing technologies, or related experience; OR Masterâs degree or equivalent in Computer Science, or related field, plus 2 years of large scale data processing experience with distributed computing technologies, or related experience.
Minimum skills required: Experience processing complex datasets with Spark. Functional programming experience with Scala. Demonstrated knowledge of Hadoop, Map Reduce, and Hive for large datasets. Data management experience with Teradata. Experience with terabytes of data and performing business analytics. Experience building data warehousing solutions. Experience with HBase. Experience streaming data using Kafka. Employer will accept any amount of professional experience with the required skills
Find one job in US 