Data Engineer (Local)

  • New York Technology Partners
  • Jersey City, New Jersey
  • Full Time

Must Have Technical/Functional Skills:

  • System Architecture & Design Lead the design of scalable, fault-tolerant mediation
  • components including file ingestion, format conversion, SFTP distribution, event monitoring, and
  • downstream delivery pipelines.
  • Binary Protocol & Telecom Data Expertise Parse, decode, and transform binary telecom data
  • formats including ASN.1-encoded CDRs/UDRs, AMA (Automatic Message Accounting) records,
  • and proprietary carrier formats at the byte-stream level.
  • Java / Spring Boot Development Build and maintain core mediation services using Java 17+
  • and Spring Boot (Spring Integration, Spring Batch, Spring Kafka); contribute to shared starters
  • and reusable platform libraries.
  • Kubernetes / OpenShift Operations Design and deploy containerized workloads on
  • OpenShift/Kubernetes; own Helm chart definitions, resource tuning, PVC strategies, horizontal
  • scaling, and rolling upgrade policies.
  • Oracle Database Design and optimize schemas for high-volume mediation metadata,
  • reconciliation state, and audit trails; write and tune complex SQL for operational reporting.
  • Site Reliability Engineering (SRE) Define and enforce SLOs/SLIs; lead incident response; drive
  • post-mortems; implement error budgets and auto-remediation patterns into the platform.
  • Advanced Observability & Monitoring Build deep observability into the platform: structured
  • logging (Log back/ELK), distributed tracing (Open Telemetry/Jaeger), metrics
  • (Micrometer/PrometheGrafana), and alerting strategies for carrier-grade availability.
  • Performance & Reliability Engineering Profile and optimize JVM performance, Kafka consumer
  • throughput, file I/O pipelines, and database query patterns; establish benchmarks and
  • regression gates.
  • Cross-Team Technical Leadership Drive architectural decisions, conduct design reviews,
  • mentor engineers, and collaborate with network, OSS/BSS, and downstream consumer teams.
  • Roles & Responsibilities
  • Hands-on experience with ASN.1 decoding, AMA record parsing, binary CDR/UDR
  • formats (3GPP, ANSI), and byte-stream manipulation
  • Strong Kubernetes and OpenShift skills: Helm, resource policies, stateful workloads, network
  • policies, operator patterns
  • Proficient in Oracle SQL and PL/SQL: schema design, indexing strategies, partitioning, explain
  • plans
  • SRE mindset: SLO/SLI definition, on-call discipline, chaos engineering fundamentals, capacity
  • planning
  • Experience building production-grade observability: Prometheus, Grafana, Open Telemetry,
  • ELK/EFK, alerting pipelines
  • Demonstrated ability to debug and resolve issues at the system level OS, JVM, network, file
  • descriptor limits, pressure, thread contention
  • Experience with Apache Kafka at scale: partition strategy, consumer group tuning, offset
  • management, dead-letter handling
  • Solid understanding of SFTP, S3/object storage, file lifecycle management, and large-scale file
  • distribution patterns
Job ID: 523507399
Originally Posted on: 6/3/2026

Want to find more Technology opportunities?

Check out the 165,503 verified Technology jobs on iHireTechnology