OiO.lk Community platform!

Oio.lk is an excellent forum for developers, providing a wide range of resources, discussions, and support for those in the developer community. Join oio.lk today to connect with like-minded professionals, share insights, and stay updated on the latest trends and technologies in the development field.
  You need to log in or register to access the solved answers to this problem.
  • You have reached the maximum number of guest views allowed
  • Please register below to remove this limitation

Azure Machine Learning - Online Endpoint Schedule/Cost management

  • Thread starter Thread starter lte__
  • Start date Start date
L

lte__

Guest
We're experimenting with MLOps on Azure Machine Learning, and as such, want to manage an Online Endpoint for inference. However, we also want to save costs, and since the software is only running in a single location for now, we know for a fact people won't be using it outside normal business hours.

The endpoint is deployed to a managed compute instance, which quotes us hourly (not based on requests) as long as the deployment (the endpoint) is live.

I haven't seen any option (neither on the UI nor the documentation) to schedule and delete a deployment automatically. I can configure AutoScaling, but I'm unsure scaling the endpoint to 0% in the nights and weekends also releases the compute (my guess is, it doesn't and we'd still be paying for the compute). I can delete the deployment by hand every night and deploy it every morning, but I'd expect to be able to do this automatically, as it would become unmanageable over time with more endpoints.

Can I - and if yes, how - reduce the cost to 0 USD of an Azure Machine Learning Online Endpoint outside business hours automatically based on a schedule? If yes, how?
<p>We're experimenting with MLOps on Azure Machine Learning, and as such, want to manage an Online Endpoint for inference. However, we also want to save costs, and since the software is only running in a single location for now, we know for a fact people won't be using it outside normal business hours.</p>
<p>The endpoint is deployed to a managed compute instance, which quotes us hourly (not based on requests) as long as the deployment (the endpoint) is live.</p>
<p>I haven't seen any option (neither on the UI nor the documentation) to schedule and delete a deployment automatically. I <em>can</em> configure AutoScaling, but I'm unsure scaling the endpoint to 0% in the nights and weekends also releases the compute (my guess is, it doesn't and we'd still be paying for the compute). I can delete the deployment by hand every night and deploy it every morning, but I'd expect to be able to do this automatically, as it would become unmanageable over time with more endpoints.</p>
<p>Can I - and if yes, how - reduce the cost to 0 USD of an Azure Machine Learning Online Endpoint outside business hours automatically based on a schedule? If yes, how?</p>
Continue reading...
 

Latest posts

Z
Replies
0
Views
1
Zachary Greenwalt
Z
M
Replies
0
Views
1
Marcos R. Guevara
M
Top