Staff Data Engineer - Craft Education

If you’re passionate about building a better future for individuals, communities, and our country—and you’re committed to working hard to play your part in building that future—consider WGU as the next step in your career.
Driven by a mission to expand access to higher education through online, competency-based degree programs, WGU is also committed to being a great place to work for a diverse workforce of student-focused professionals. The university has pioneered a new way to learn in the 21st century, one that has received praise from academic, industry, government, and media leaders. Whatever your role, working for WGU gives you a part to play in helping students graduate, creating a better tomorrow for themselves and their families.
The salary range for this position takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs.
At WGU, it is not typical for an individual to be hired at or near the top of the range for their position, and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is:
Grade: Technical 411
Pay Range: $157,000.00 - $243,400.00
Job Description
The Staff Data Engineer should be agnostic to tools and should be able to supervise, design, architect and code using Apache Spark and other cloud technologies. The position will supervise and design how data will flow through hybrid data environments comprised of open-source big data platforms and traditional database systems.
The core responsibility for this position includes supervision of data engineering technical aspects, design of data and system architecture for the Data Lake and data warehouse, supervision of the technical aspects of a data engineering team and projects encompassing dimensional and normalized data modeling.
The Staff Data Engineer will improve technical standards in the environment ensuring optimal use of data warehouse and other data stores to solve business problems. They will serve as the lead engineer and go to person for all aspects of the data engineer team including solution architecture of data systems.
Essential Functions and Responsibilities:

Supervise work on cloud technologies and architect scalable and performant Data Warehouse/Lake systems
Establish design and methodology for database build processes.
Supervise the architecture and design of complete data model solutions.
Supervise necessary data protection and security processes.
Create and design extract processes for data access layer.
Translate business problems/information requirements accurately to logical/physical data models aligning with customers’ data architecture standards.
Supervise and perform research and analysis to find solutions for complex business problems.
Monitor job performance and fine tune Spark SQL queries as appropriate on a regular basis.
Supervise the profiling of data, the publishing of data profiles and corrective actions if required to ensure data quality.
Supervise and perform documentation / reverse engineering / analysis of data mapping using data integration code/tools.
Work with APIs for data wrangling and integrations with other systems data in the EDW.
Perform impact analysis using Data Integration/Data Virtualization tool repositories, DB data dictionary, UNIX scripts and frontend code on versioning systems.
Analyze / research data on multiple platforms as wells as multiple heterogeneous databases including custom developed databases.
Positively impact projects by completing tasks assigned on time.
Communicate technical and domain knowledge as it relates to work, to both technical and non-technical audiences.
Ingest and transform structured, semi-structured, and unstructured data from sources including relational databases, NoSQL, external APIs, JSON, XML, delimited files, and more.
Support business and functional requirements and translate these requirements into robust, scalable, solutions.
Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation.
Help continually improve ongoing reporting and analysis processes, automate, or simplify self-service modelling and production support for customers.
Performs other related duties as assigned.
Knowledge, Skill and Abilities:

Solid design skills for creating non-competing processes for data transfer between OLTP and OLAP sources/sinks
Expertise with analytical reporting tools, preferably Metabase
Mastery in code based ETL/ ELT tools for importing and exporting data across disparate systems.
Expertise in analytic skills related to working with unstructured datasets.
Use of industry best practices for code development, testing, implementation and documentation.
Ability to evaluate and prioritize work based on the organization’s needs.
Ability to supervise cross team projects to accomplish data integrations and pipelines.
Supervisory abilities for data engineering team with respect to technical design and architecture.
Excellent verbal & written communication, along with technical documentation
Ability to work and deliver in a team environment
Ability to manage the use of tools like Jira, Confluence, GitHub
Architect and Develop processes for audit of Data Integrity
Ability to mentor Associate/Senior/Data Engineer in data pipeline architecture and coding standards
Supervise Validation and testing to analyze and debug issues
Mastery of AWS cloud technologies and REST APIs
Mastery of relational SQL and NoSQL databases
Mastery with object-oriented/object function scripting languages: Python, Java, Scala
Mastery of big data tools: Hadoop, Spark, Kafka, Databricks, etc.
Organizational or Student Impact:

Recommends and implements changes in technical/business processes; identifies areas for improvement.
Helps lead/coordinate extremely complex technical projects and programs and leads development and implementation of innovative solutions for specialized technical issues.
Works proactively; identifies and helps prevent/ solve problems that may cross disciplines.
Fully understands and quantifies project risks with impact. Identifies, generates, and implements innovative solutions.
Problem Solving & Decision Making:

This individual accomplishes goals and objectives independently.
Builds and leads teams, influencing decisions and results.
Understands and aligns to Agile practices, knowing that Agile is a team level framework that is not rigid, but flexible to support the notion of continuous delivery via iterative planning, design, implementation and operational delivery with quality.
Uses discretion to fully scope, design, and implement solutions to complex technical problems.
The individual provides regular technical advice and direction to technical teams and management.
Models and helps set high standards for effective interactions with internal and external individuals.
Communication & Influence:

Communicates with parties within and outside of their job function and typically has responsibilities for communicating with parties external to the organization.
Works to influence others to accept and understand new concepts, practices, and approaches. Requires ability to communicate with executive leadership regarding matters of significant importance to the organization.
This individual may conduct briefings with senior leaders within the technical function.
Leadership:

Frequently responsible for providing guidance, coaching, and training to other employees across the Company within the area of expertise.
Responsible for managing large, complex project initiatives or strategically important solutions to the organization, involving large cross-functional teams.
Understands and works, with their team, to demonstrate intention and delivery via metrics. DORA metrics are cultural in nature and we use them to drive high performance teams, empowered by their own ideas on how to adjust to improve measures.
May have direct reports but generally fewer than three.
Job Qualifications:
Minimum Qualifications:

M. S. in Business, Management Information Systems, Computer Science, or a related field, or an equivalent combination of experience and training.
Six or more years of experience as a Data Engineer, Data Integration, Big Data, or Business Intelligence, Software Engineer
Prior experience acting as a Team Lead, where you run the team from a technical perspective, creating ownership and accountability for high performance delivery. You will be a partner with your manager and will be the primary point of contact for team activities/deliveries
The individual is acknowledged within the group as a subject matter expert.
Typically requires a University Degree or equivalent experience.
Preferred Qualifications:

Strong experience with early stage companies distance education and distance learning students is preferred.
6 years of prior relevant experience.
Physical Requirements:

Prolonged periods sitting at a desk and working on a computer.
Must be able to lift up to 15 pounds at times.
Position & Application Details
Full-Time Regular Positions (classified as regular and working 40 standard weekly hours): This is a full-time, regular position (classified for 40 standard weekly hours) that is eligible for bonuses; medical, dental, vision, telehealth and mental healthcare; health savings account and flexible spending account; basic and voluntary life insurance; disability coverage; accident, critical illness and hospital indemnity supplemental coverages; legal and identity theft coverage; retirement savings plan; wellbeing program; discounted WGU tuition; and flexible paid time off for rest and relaxation with no need for accrual, flexible paid sick time with no need for accrual, 11 paid holidays, and other paid leaves, including up to 12 weeks of parental leave.
How to Apply: If interested, an application will need to be submitted online. Internal WGU employees will need to apply through the internal job board in Workday.
Additional Information
Disclaimer: The job posting highlights the most critical responsibilities and requirements of the job. It’s not all-inclusive.
Accommodations: Applicants with disabilities who require assistance or accommodation during the application or interview process should contact our Talent Acquisition team at recruiting@wgu.edu.
Equal Employment Opportunity: All qualified applicants will receive consideration for employment without regard to any protected characteristic as required by law.