---
title: "The risks of building apps on ChatGPT"
description: "The post argues that applications with critical AI features should avoid relying on proprietary, externally hosted models such as OpenAI’s ChatGPT and consider self-hosted open source alternatives. It identifies single-provider, regulation or policy, financial, and governance risks, illustrating the first with a Personal AI Fitness Trainer that failed during an OpenAI outage on November 8, 2023. When the AI is the app’s primary value proposition, an outage, changed behavior, denied usage, price increase, or provider leadership crisis can make the service unusable or threaten the business; less-central integrations may instead cause only degraded experience. Self-hosting a model can insulate an application from provider interruptions, licensing or usage-fee changes, regulator- or company-driven behavior changes, and leadership turmoil, while introducing GPU capital and operating costs with rented cloud GPU access available as an alternative to owning GPUs."
---

# The risks of building apps on ChatGPT

[Fly.io](https://yomu.fyi/company/fly-io) · Dec 5, 2023

**Type:** Explainer

## Summary

The post argues that applications with critical AI features should avoid relying on proprietary, externally hosted models such as OpenAI’s ChatGPT and consider self-hosted open source alternatives. It identifies single-provider, regulation or policy, financial, and governance risks, illustrating the first with a Personal AI Fitness Trainer that failed during an OpenAI outage on November 8, 2023. When the AI is the app’s primary value proposition, an outage, changed behavior, denied usage, price increase, or provider leadership crisis can make the service unusable or threaten the business; less-central integrations may instead cause only degraded experience. Self-hosting a model can insulate an application from provider interruptions, licensing or usage-fee changes, regulator- or company-driven behavior changes, and leadership turmoil, while introducing GPU capital and operating costs with rented cloud GPU access available as an alternative to owning GPUs.

## Context

The post addresses the risks of making a critical application feature depend on a proprietary, externally hosted AI provider. It distinguishes critical AI dependencies from nonessential external services and notes that the consequences depend on how central the AI component is to the business.

## Approach / What changed

It advocates using an open source language model that can be self-hosted, potentially fine-tuned to fit the application’s needs. Hosting inference independently is presented as a way to reduce exposure to provider outages, pricing, policy, regulatory, licensing, and leadership changes, with cloud GPU rentals offered as an alternative to purchasing dedicated hardware.

## Takeaways

- A Personal AI Fitness Trainer failed during an OpenAI outage on November 8, 2023, demonstrating how a provider interruption can make an AI-centered application unavailable.
- Self-hosting can protect against unexpected changes to a provider’s licensing, inference costs, model behavior, usage policies, or leadership.
- Dedicated GPUs cost more than renting limited access to a provider, while self-hosting adds capital and operating expenses that can also be addressed through cloud GPU access.

**Tags:** [AI](https://yomu.fyi/topic/ai), [GPU](https://yomu.fyi/topic/gpu), [Open Source](https://yomu.fyi/topic/open-source)

- Source: [Fly.io](https://fly.io/blog/the-risks-of-building-apps-on-chatgpt)
- Source URL: https://fly.io/blog/the-risks-of-building-apps-on-chatgpt
- Ingested by Yomu: 2026-09-03T01:26:30.832Z

[Read original post](https://fly.io/blog/the-risks-of-building-apps-on-chatgpt)