Inference Endpoints
  • 🌍OVERVIEW
    • BOINC AI Inference Endpoints
    • Security & Compliance
    • Supported Tasks
    • API Reference (Swagger)
    • Autoscaling
    • Pricing
    • Help & Support
    • FAQ
  • 🌍GUIDES
    • Access the solution (UI)
    • Create your first Endpoint
    • Send Requests to Endpoints
    • Update your Endpoint
    • Advanced Setup (Instance Types, Auto Scaling, Versioning)
    • Create a Private Endpoint with AWS PrivateLink
    • Add custom Dependencies
    • Create custom Inference Handler
    • Use a custom Container Image
    • Access and read Logs
    • Access and view Metrics
    • Change Organization or Account
    • Pause and Resume your Endpoint
  • 🌍OTHERS
    • Inference Endpoints Version
    • Serialization & Deserialization for Requests
Powered by GitBook
On this page
  1. GUIDES

Create your first Endpoint

PreviousAccess the solution (UI)NextSend Requests to Endpoints

Last updated 1 year ago

Create an Endpoint

After your first login, you will be directed to the Endpoint creation page. As an example, this guide will go through the steps to deploy distilbert-base-uncased-finetuned-sst-2-english for text classification.

1. Enter the BOINC AI Repository ID and your desired endpoint name:

2. Select your Cloud Provider and region. Initially, only AWS will be available as a Cloud Provider with the us-east-1 and eu-west-1 regions. We will add Azure soon, and if you need to test Endpoints with other Cloud Providers or regions, please let us know.

3. Define the [Security Level](security) for the Endpoint:

4. Create your Endpoint by clicking **Create Endpoint**. By default, your Endpoint is created with a medium CPU (2 x 4GB vCPUs with Intel Xeon Ice Lake) The cost estimate assumes the Endpoint will be up for an entire month, and does not take autoscaling into account.

5. Wait for the Endpoint to build, initialize and run which can take between 1 to 5 minutes.

6. Test your Endpoint in the overview with the Inference widget 🏁 🎉!

←Access the solution (UI)

🌍
  • Create an Endpoint
  • 1. Enter the BOINC AI Repository ID and your desired endpoint name:
  • 2. Select your Cloud Provider and region. Initially, only AWS will be available as a Cloud Provider with the us-east-1 and eu-west-1 regions. We will add Azure soon, and if you need to test Endpoints with other Cloud Providers or regions, please let us know.
  • 3. Define the [Security Level](security) for the Endpoint:
  • 4. Create your Endpoint by clicking **Create Endpoint**. By default, your Endpoint is created with a medium CPU (2 x 4GB vCPUs with Intel Xeon Ice Lake) The cost estimate assumes the Endpoint will be up for an entire month, and does not take autoscaling into account.
  • 5. Wait for the Endpoint to build, initialize and run which can take between 1 to 5 minutes.
  • 6. Test your Endpoint in the overview with the Inference widget 🏁 🎉!