Actual AI

Brief

Actual AI is building an AI-powered platform for managing software development.This study focuses on evaluating the user experience of senior-level engineers and managers as they onboard and use the platform for the first time.

Team

4 UX Researchers, 1 UX Designer, 2 Engineers

Timeline

January 2026 - June 2026 | 6 Months

An agentic workflow dashboard

Actual AI is building an AI-powered platform for managing software development. The platform helps senior developers and managers improve efficiency by automating functions using the Architecture and Management Agents. The workflow is divided into three parts - the dashboard which allows users to see the overall configuration and pending items. The Architecture agent - Analyzes code contributions and development tickets, enforces rules and guidelines for code written by humans and AI, provides actionable recommendations. The management agent - automates progress reports and measures velocity by developer, team and project.

SUS Score

01234567890123456789012345601234567890123456789012345678901.01234567890123456789012345678901201234567890123456789012345

Implemented Recommendations

0123456789012345678901012345678901234567890123456789012345

Overview of all usability issues

1

Minor: Causes some hesitation or slight irritation.

Minor: Causes some hesitation or slight irritation.

2

Moderate: Causes occasional task failure for some users; causes delays and moderate irritation.

Moderate: Causes occasional task failure for some users; causes delays and moderate irritation.

3

Critical: Leads to task failure; causes user extreme irritation.

Critical: Leads to task failure; causes user extreme irritation.

Inconsistent onboarding flow

Inconsistent onboarding flow

3

Management agent was missing

Management agent was missing

3

Users felt lost landing on boarding on the homepage after onboarding

Users felt lost landing on boarding on the homepage after onboarding

3

Platform lacked stability disrupting users flows

Platform lacked stability disrupting users flows

3

Functionality of architecture agent in unclear

Functionality of architecture agent in unclear

3

Developer minutes is ambiguous

Developer minutes is ambiguous

3

Nested buttons resulting in confusion

Nested buttons resulting in confusion

3

Lack of agency over context files

Lack of agency over context files

2

Management agent doesn’t feel agentic

Management agent doesn’t feel agentic

1

Method

A group of six participants were selected.

  • They have not used Actual AI’s platform yet

  • Their software project team size is 2 to 99 people

  • Responsible for:

    • Contributing production code

    • Reviewing code (pull requests, code quality)

    • Managing repository-level technical decisions

    • Managing team members or projects

    • Their team uses AI agents for coding


Testing took place via Zoom, and participants shared their screen so their actions could be observed and recorded. Participants onboarded to the Actual AI platform and explored the dashboard.

3

Usability Finding: Nested CTAs Caused Navigation Disruption

During usability testing, a nested button architecture created severe visual confusion and disrupted the primary user flow. Fifty percent of participants (3 out of 6) unintentionally clicked the nested "Browse by Category" control and completely missed entering the main feature. This conflicting touch target eroded users' confidence in system consistency, causing Participant 6 to exclaim, "I swear I clicked on this before and it was different! How do I go back?" To resolve this cognitive friction, it was recommended to decouple the secondary CTA from the main feature card to establish a clear visual hierarchy. Restructuring these interactive elements restored navigation predictability and ensured seamless access to the core feature. The final design was implemented with an added hover state.

More coming soon :-)

Actual AI

Actual AI

Brief

A Financial Goal/ Investment dashboard experience that allows users to discover, plan and implement their financial goals divided in monthly installments along with access to a personalized dashboard and resources on ways to get started with investments.

Team

1 Front end engineer, 1 Back end engineer, 1 Project Manager, 1 UX Designer (Me!)

Timeline

May 2025 | 1 Month

Brief

A Financial Goal/ Investment dashboard experience that allows users to discover, plan and implement their financial goals divided in monthly installments along with access to a personalized dashboard and resources on ways to get started with investments.

Team

1 Front end engineer, 1 Back end engineer, 1 Project Manager, 1 UX Designer (Me!)

Timeline

May 2025 | 1 Month