From SigV4 Proxy to Universal Multi-Provider AI Gateway & AWS Bedrock SigV4 Bridge (BYOK)
Track ongoing performance upgrades, BYOK multi-provider routing (Gemini 2.0, Claude 3.5, Llama 3), Bedrock model support, and infrastructure milestones from Kiyas Labs Technologies.
- Amazon Bedrock Claude 3.5 Sonnet full streaming support with sub-millisecond SSE token delivery.
- Asynchronous Stream-Teeing Engine: Reassembles and indexes completion embeddings in background workers.
- Titan Embeddings v2 vector lookup pipeline optimized to sub-18ms roundtrip.
- Interactive Sandbox Console launched with real-time simulated inference metrics.
- Migrated semantic vector store to Amazon Aurora Serverless with pgvector HNSW indexing.
- Ephemeral KMS Vault: In-memory zeroization of provider API keys upon stream termination.
- Zero-downtime Bedrock auto-failover on upstream 429/503 rate-limit codes within 4ms.
- Automated PII redaction engine operating in volatile RAM buffers.
- Initial Public Beta release of PromptRelay™ by Kiyas Labs Technologies.
- AWS SigV4 Translation Bridge converting OpenAI Bearer tokens to AWS HMAC-SHA256 signatures.
- Core drop-in endpoint support: /v1/chat/completions and /v1/embeddings.
- Support for Python OpenAI SDK, TypeScript / Vercel AI SDK, and LangChain.
Upcoming Engineering Roadmap
Features currently under active development for upcoming beta iterations.
AWS VPC PrivateLink Dedicated Relays
Provision private VPC endpoints for healthcare and financial institutions requiring 100% air-gapped gateway connectivity.
Multi-Tenant Token FinOps & Custom Quotas
Enterprise team hierarchy with department-level budget ceilings, anomaly alerting, and automated AWS Marketplace billing allocation.
Bedrock Provisioned Throughput Smart Routing
Dynamic hybrid routing across on-demand Bedrock endpoints and provisioned throughput units (PTUs) for maximum utilization.
Request Next-Gen Gateway Features
Direct Technical Lead Inquiry
Dedicated Routing Channels
Enterprise Sandbox
enterprise@kiyaslabs.techProvisioning for enterprise subscriptions, dedicated VPC relays, and HIPAA BAAs.
Developer Support
support@kiyaslabs.techInquiries regarding the AWS SigV4 translation bridge, OpenAI SDK drop-in, or stream-teeing.
Security Disclosures
security@kiyaslabs.techEncrypted PGP channel for vulnerability reporting, pen-test reports, and compliance reviews.
Operating Entity for PromptRelay™ • Response SLA: Within 1 Business Day