Building the Decision-Making Brain for Humanoid Robots

The client is a robotics solutions company that develops physical robots for real-world tasks. At the core of its system is an intelligent decision-making module that translates natural human language into precise physical actions. Drawing on camera, sensor, and audio inputs for context, the system also supports personalized user interactions and maintains safety through built-in guardrails and defined robot roles.

3-Month Phase 1 Pilot

Delivered a functional early version in three months, keeping pace with the vision, cloud, and hardware teams’ wider development milestones. The system is running in both simulation and on physical robot hardware, with key security-patrol flows demonstrated end-to-end and approved by the client.

1 Unified Brain

Replaces separate conversational and task-execution logic across all robot roles with one consistent decision layer, now powering the core autonomous security-patrol flows.

100% Interruptible Execution

Urgent safety events can preempt a task already in progress, preserve its state, and allow the robot to resume exactly where it left off afterward.

Multi-Modal Awareness

Spoken requests, vision events, camera, sensor, navigation, and audio inputs are processed as first-class context, enabling the robot to plan and react based on its real-world environment.

Configuration-Driven Robot Roles

Each robot’s persona and permitted skills are defined through configuration, allowing the client to introduce new roles without changing or redeploying the core brain.

Client information background
Anonymous client logo

About the client

A humanoid robotics company backed by a major technology group, developing intelligent humanoid robots for real-world applications. Founded in 2025 and based in Southeast Asia, the company combines robotics, AI, sensing, and automation to create safe, human-centric machines designed to operate in everyday environments. Its vision is to advance humanoid robotics from research into practical, scalable deployment across areas such as security, surveillance, assistance, and other real-world services.

The challenge

The client needed a single, intelligent decision layer that could translate natural language into precise physical actions while remaining safe, interruptible, and responsive to multiple input sources in real time. Unlike a conversational AI, errors in a robotic system can have physical consequences, making reliability critical. The system also had to coordinate vision, cloud, and hardware teams working across different interfaces and release cadences, all within an aggressive three-month MVP timeline.

From Language to Safe Physical Action
The system needed to convert human sentences and real-time environmental events into verified motion sequences without sacrificing accuracy. Role-scoped skill definitions and privileged-user configuration ensured guardrails were applied across both verbal output and physical task execution. For its first security-patrol use case, the system needed to turn requests and detected anomalies into plans, execute those plans through the hardware, and report the outcome.
Handling Interruptions Without Losing Progress
Physical tasks are rarely uninterrupted. Urgent requests, unexpected sensor conditions, and real-time priority shifts all required a reliable mechanism to preempt, checkpoint, and resume tasks exactly where they left off. This was particularly important when the robot detected safety-critical events, such as a person falling or a door being left open, while another task was already underway.
Managing Multi-Modal Inputs and Memory at Scale
The system had to process voice, camera, sensor, navigation, and audio simultaneously while surfacing user preferences and task history automatically as context for whichever component was active. These inputs came from systems managed by separate vision, cloud, and hardware teams, each with its own interfaces and release cadence. The architecture therefore had to remain stable as integrations evolved while also supporting future robot roles without requiring a rewrite.

Why CodeLink?

The client needed a partner with proven expertise across intelligent AI systems, real-time systems, and physical hardware integration; a combination that few teams are equipped to handle end-to-end. CodeLink combined that technical depth with experience taking AI-based systems into production, enabling the team to contribute from week one, avoid costly early mistakes, and design the system around real-world reliability while keeping pace with the wider robotics programme.

The result

CodeLink delivered a working pilot in three months. It now operates in both simulation and on physical robot hardware, with the core security-patrol flows demonstrated end-to-end and approved by the client.

One Brain Across All Robot Roles
Q&A, motion planning, and emergency response now run through a shared decision and orchestration layer, eliminating duplicate role-specific logic. Every request is classified once and owned for the full lifecycle by exactly one specialist component until resolved. This same foundation supports the initial autonomous security-patrol role while remaining adaptable to future use cases such as tour guidance and home assistance.
Reliable Interruption and Resumption
Urgent requests now reliably preempt tasks in progress without losing work already done. The interrupted task checkpoints with full state preserved, resuming exactly where it left off with no data loss or restart required. Safety-critical vision events can therefore take priority immediately without permanently abandoning the robot’s existing task.
Multi-Modal Context as a First-Class Input
Camera, sensor, and structured data feeds now reach the decision-making system as primary context alongside conversation. This gives the system a more accurate picture of the robot’s environment before any physical action is planned or executed. The robot can respond both to direct spoken instructions and to real-time events detected during an autonomous patrol.
Extensible by Design
New skills and robot roles can now be defined without re-deriving routing, priority, or checkpoint logic each time. The client can scale its robot fleet and expand the system’s capabilities without rebuilding the underlying foundation. Each role’s persona and permitted skills are configuration-driven, meaning new roles can be introduced without modifying or redeploying the core brain. The engagement remains in active development, with the autonomous patrol product established as the next major milestone.

Engineering Excellence.
Built for Enterprise and Institutional Innovation.

Contact Us
background

CodeLink Newsletter

Stay up to date with the latest insights on software engineering and AI strategy from CodeLink.

CodeLink

We partner with enterprises and institutions to turn complex technology challenges into reliable digital systems. Through expert software engineering, AI implementation, and disciplined delivery, we help organizations modernize operations, strengthen platforms, and deliver measurable business outcomes.

Contact Us

(+84) 2839 333 143info@codelink.io
Book A Discovery Call
2026 © CodeLink Limited.
All right reserved.
Privacy Policy