replicate / cog

What it does

• Docker containers without the pain. Writing your own Dockerfile can be a bewildering process. With Cog, you define your environment with a simple configuration file and it generates a Docker image with all the best practices: Nvidia base im
• No more CUDA hell. Cog knows which CUDA/cuDNN/PyTorch/Tensorflow/Python combos are compatible and will set it all up correctly for you.
• Define the inputs and outputs for your model with standard Python. Then, Cog generates an OpenAPI schema and validates the inputs and outputs.
• Automatic HTTP inference server. Your model's types are used to dynamically generate a RESTful HTTP API using a high-performance Rust/Axum server.
• Ready for production. Deploy your model anywhere that Docker images run. Your own infrastructure, or Replicate.