The Systems Integration Engineer will be responsible for managing data flows for a wide range of devices. They will utilize Apache NiFi and Python to maintain and engineer data flows to meet customer requirements. They will also build out Grafana dashboards to visualize the data flow metrics and infrastructure status. They will be responsible for interfacing with various API endpoints as well as maintaining holistic diagrams of each data flow.
The following technologies are used:
Operating Systems: RHEL7,9, Windows Server 2012, 2016, 2019
Databases: MongoDB, PostgreSQL, Oracle DB
Languages: Python, Bash, PowerShell, Java, JavaScript, HTML, CSS
Virtualization: VMWare, Nutanix
Other: Apache NiFi, Grafana, Microsoft Visio, Cross Domain Solutions, Ansible, Active Directory
- Develop and sustain intricate data flows from a multitude of sources leveraging Apache NiFi.
- Devise innovative approaches for intricate data manipulation challenges utilizing Python.
- Employ Apache NiFi and custom Python scripts to retrieve data from remote APIs, modify the data, and then distribute it according to customer requirements.
- Transform legacy Java implementations into holistic Python solutions, leveraging modern libraries to achieve equivalent functionality.
- Build Grafana dashboards to display data flow metrics and infrastructure status.
- Engage in weekly engineering review board sessions, offering technical insights on change requests from both the internal team and clients.
- Analyze current data flows for inefficiencies and propose optimized remedies.
- Design secure cross-domain channels to facilitate data movement between networks of varying security levels.
- Document new and existing data flows using Microsoft Visio.
- Evaluate change request documentation for technical precision, sourced both internally and externally
|