How should you host your app in 2024?
All posts

An open-source AI QA Engineer

If you’re working on a new app in 2023, you’re likely thinking about how to integrate Large Language Model (LLM) based features into your code. The hottest API to access this kind of technology is ChatGPT from OpenAI. Coherence is a great place to deploy your full-stack GPT-powered app, as we show in this new starter repo which deploys an AI QA Engineer.
March 7, 2023

If you’re working on a new app in 2023, you’re likely thinking about how to integrate Large Language Model (LLM) based features into your code. The hottest API to access this kind of technology is ChatGPT from OpenAI. It’s 10x cheaper and apparently just as good as earlier versions. In its own version of Moore’s law, it’s moving fast!

There are a wide variety of starter templates out there for interacting with ChatGPT. Our goal in releasing another one is to:

  • Show how to use python to access the API (it seems like the majority of examples are in typescript)
  • Give an example of how this kind of app can be deployed with Coherence

Deploying on Coherence also gives you an easy path to using the resources (see our docs) required to build a real app on top of this technology (e.g. postgres database, redis cache, etc). For many apps, you’ll still need things like users, data storage, and various processing logic to get the right inputs and outputs for ChatGPT sdk calls. The integrated cloud support that Coherence provides for these resources makes it easy to use them in your app.

The OpenAI GPT starter repo we’re showing here is written in python, so if you are using django, flask, or FastAPI it should be easy to adapt. Other languages or frameworks such as Ruby on Rails or Next.js, are easy to deploy on Coherence as well. We’re happy to help, or you can follow the other examples in our docs.

The app in the starter repo is an AI-powered QA engineer that writes automated tests using playwright.js. You can see a working demo of the app here. If you want some example code to run against the demo, you can use this simple http server in go. Check out the open-source starter on github here. It’s easy to get started, just:

  • Clone the repo into your own account. It’s a template repo so you can easily copy it on github.com directly.
  • Sign up for a Coherence account at app.withcoherence.com.
  • Create your first application on Coherence. We’ll guide you through integrating github with the repo and either Amazon Web Services (AWS) or Google Cloud Platform (GCP). It should take about 5 minutes.
  • That’s it! You’re ready to create a production quality app with a built-in workflow in your own cloud account. That includes cloud-hosted remote IDE, automatic full-stack branch previews with database seeding/snapshot loading, and managed deployment pipelines that support advanced features like parallel unit tests and end to end tests, out-of-the-box!