macOS · SwiftUI

SuggstmacOS application

Suggst combines reference context, meeting-specific context and transcribed speech to prepare an answer after an explicit user action.

Overview

Keep the meeting moving with the right context at hand.

The problemA question in a meeting may require combining reference information with discussion-specific details while the conversation continues.

The solutionSuggst pairs two saved contexts with authorized audio capture. On a manual trigger, it transcribes speech, extracts the request and prepares a contextual answer.

User workflow

Two complementary contexts

Save reusable reference context and information specific to the current conversation. Long-lived reference information and discussion-specific details are stored separately.

1 / 4: Prepare the contexts. Previous step / Next step

Technical architecture

A SwiftUI-driven pipeline processes audio locally, extracts the request and calls OpenAI with selected context.

macOS application

SwiftUI

Interface and explicit user action
Starts and ends

Audio capture

AVFoundation, ScreenCaptureKit

Microphone, system audio and identified clips
Sends a clip

Local processing

Swift, WhisperKit

Final transcription and request extraction
Contextual request

Generation

OpenAI Responses API

Answer grounded in the request and contexts
  • macOS application: SwiftUI. Interface and explicit user action Starts and ends.
  • Audio capture: AVFoundation, ScreenCaptureKit. Microphone, system audio and identified clips Sends a clip.
  • Local processing: Swift, WhisperKit. Final transcription and request extraction Contextual request.
  • Generation: OpenAI Responses API. Answer grounded in the request and contexts

Technical challenges

01

Keep each question isolated

Constraint

Asynchronous operations may finish out of order or deliver duplicate events.

The solution

Per-question identities, sealed results and idempotent ingestion that rejects inconsistent events.

02

Coordinate macOS audio sources

Constraint

Microphone and system audio rely on separate providers and permissions.

The solution

Two coordinated native providers, with an explicit state when system capture is unavailable.

03

Handle sensitive context data

Constraint

Saved contexts and conversation content may contain sensitive information.

The solution

Local document storage, an API secret in Keychain and targeted context sent to OpenAI.

Main technical stack

SwiftXcodeOpenAI APIJSONBashSwiftUIWhisperKitScreenCaptureKit

Outcomes and learnings

Integrated native application

Context editing, listening, preparation and answer views brought together in a SwiftUI interface.

Contextual answer pipeline

Audio capture, WhisperKit transcription, local extraction and OpenAI generation tied to a manual trigger.

Diagnostics and validation tooling

Developer cockpit, structured traces, test corpora and build scripts included in the repository.