Runtime Engineer (C/C++)
Dubai, United Arab Emirates
Full timeOn-site
Job description
About Us
We are a tech company specializing in the design and development of cutting-edge, customized server hardware solutions optimized for artificial intelligence and machine learning applications. Our mission is to empower businesses and researchers to accelerate their AI initiatives by providing them with high-performance, scalable, and energy-efficient hardware infrastructure.
As a rapidly growing company at the forefront of AI hardware innovation, we are constantly seeking talented and motivated individuals to join our team. We offer a dynamic and challenging work environment, with opportunities to make a significant impact on the future of AI technology.
You'll Collaborate With
Compiler engineers, firmware & driver engineers, hardware architects, ML framework engineers and performance & validation teams
What You'll Own
-
The core runtime architecture that bridges the compiler and the hardware
-
Runtime execution engine performance and stability
-
Device memory management design and efficiency
-
Command submission and hardware interaction layer (in collaboration with firmware/driver teams)
-
Concurrency and scheduling model for model execution
-
Observability tooling (profiling, logging, tracing) within the runtime
-
Technical design decisions that ensure long-term scalability and maintainability
Minimum Qualifications
-
5–8+ years of experience in systems software, runtime systems, or performance-critical infrastructure
-
Strong proficiency in C/C++and Python
-
Solid understanding of fundamentals of operating systems, multi-threading, synchronization, memory management, and cache behavior
-
Experience working close to hardware (GPU, accelerator, driver, or firmware environments)
-
Familiarity with command queues, execution engines, and DMA-based systems
-
Understanding of computational graphs, tensor execution, and memory layouts
-
Experience profiling and optimizing latency and throughput in performance-sensitive systems
Preferred Qualifications
-
Experience building or architecting a runtime from scratch
-
Familiarity with MLIR, LLVM, or compiler-runtime interfaces
-
Experience with one or many from CUDA, ROCm, TensorRT, TVM, XLA, ONNX Runtime or similar runtimes
-
Experience integrating custom hardware backends into PyTorch, ONNX or OpenXLA
-
Knowledge of quantization and mixed-precision inference
-
Experience with multi-device or distributed execution
-
Background in AI accelerator or semiconductor environments
What Success Looks Like
-
You enable reliable end-to-end execution of compiled models on our NPU
-
Runtime overhead is minimal and performance targets are consistently met
-
Memory management and scheduling are efficient and scalable
-
The runtime architecture is robust, maintainable, and extensible
-
Compiler, firmware, and hardware teams can build confidently on top of your execution layer
-
The system supports real-world AI workloads with stability and observability
Join us in our mission to democratize AI compute — where your firmware expertise becomes the bedrock of tomorrow's AI breakthroughs.