TTA:Business Model: Difference between revisions
No edit summary |
No edit summary |
||
| (13 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
[[TTA:Artificial_Intelligence | | __NOTITLE__ | ||
{{portal header | |||
| title = The Business Model | |||
| notes = | notes = This is an experimental feature that aims to test artificial intelligence applied to our archive. [[TTA:Artificial_Intelligence | The TTA's AI]] - [[TTA:AI_Overview | Overview]] - [[TTA:Crowdfunding_campaign |Donate]] | |||
[[File:Talking-2.png|50px|link=|The Traditional Tune Archive's Assistant]] '' AI comes at costs: that's is why '' | |||
}} | |||
= The AI Business Model = | = The AI Business Model = | ||
| Line 8: | Line 13: | ||
Below you can see a breakdown of the cost based on the fact that we have about 2,500 users and (assuming) 10 percent of those users have a desire (or need) to interact with AI. | Below you can see a breakdown of the cost based on the fact that we have about 2,500 users and (assuming) 10 percent of those users have a desire (or need) to interact with AI. | ||
The short version: in the scenario I just outlined (10% of users using the AI Assistant) it takes | == The short version: == | ||
in the scenario I just outlined (10% of users using the AI Assistant) it takes 315$ per month (284€ at today's exchange rate). | |||
We therefore have two possible scenarios:{{break}} | We therefore have two possible scenarios:{{break}} | ||
| Line 20: | Line 26: | ||
—— | —— | ||
The long version: to estimate the monthly cost of offering our OpenAI Assistant (TTAssist) to our subscribers, we’ll need to consider several factors: | == The long version: == | ||
to estimate the monthly cost of offering our OpenAI Assistant (TTAssist) to our subscribers, we’ll need to consider several factors: | |||
# Model Used: The cost per token varies depending on the AI model you’re using (e.g., GPT-3.5 Turbo, GPT-4).{{break}} | # Model Used: The cost per token varies depending on the AI model you’re using (e.g., GPT-3.5 Turbo, GPT-4).{{break}} | ||
| Line 28: | Line 35: | ||
'''You can think of tokens as pieces of words, where 1,000 tokens is about 750 words.''' | '''You can think of tokens as pieces of words, where 1,000 tokens is about 750 words.''' | ||
=== Identify the AI Model and Pricing === | |||
I believe that the only model applicable to our needs is the GPT-4, and so I will not consider other models (such as GPT-3.5 Turbo). {{break}} | I believe that the only model applicable to our needs is the GPT-4, and so I will not consider other models (such as GPT-3.5 Turbo). {{break}} | ||
| Line 37: | Line 44: | ||
* $0.01500 per 1,000 tokens for output | * $0.01500 per 1,000 tokens for output | ||
=== Estimate Usage Volume === | |||
Since we have 2,500 subscribers, we need to estimate how many will use the assistant and how frequently: | Since we have 2,500 subscribers, we need to estimate how many will use the assistant and how frequently: | ||
| Line 46: | Line 53: | ||
* 250 active users * 10 interactions = 2,500 total interactions per month | * 250 active users * 10 interactions = 2,500 total interactions per month | ||
=== Estimate Token Consumption === | |||
An average interaction includes both the user’s question and the assistant’s response: | An average interaction includes both the user’s question and the assistant’s response: | ||
| Line 54: | Line 61: | ||
Total Tokens per Interaction: 100 (input) + 200 (output) = 300 tokens | Total Tokens per Interaction: 100 (input) + 200 (output) = 300 tokens | ||
==== Calculate Monthly Token Usage ==== | |||
* Total Tokens per Month: 2,500 interactions * 300 tokens = 750,000 tokens{{break}} | * Total Tokens per Month: 2,500 interactions * 300 tokens = 750,000 tokens{{break}} | ||
| Line 60: | Line 67: | ||
* Output Tokens Total: 2,500 interactions * 200 tokens = 500,000 tokens | * Output Tokens Total: 2,500 interactions * 200 tokens = 500,000 tokens | ||
== Calculate Monthly Cost == | === Calculate Monthly Cost === | ||
For GPT-4 (8K context): | For GPT-4 (8K context): | ||
| Line 68: | Line 75: | ||
• Total Cost: $37.50 (input) + $225.00 (output) = $262.50 | • Total Cost: $37.50 (input) + $225.00 (output) = $262.50 | ||
== Add a Buffer for Variability == | === Add a Buffer for Variability === | ||
It’s prudent to include a buffer (e.g., 20%) to account for unexpected spikes in usage: | It’s prudent to include a buffer (e.g., 20%) to account for unexpected spikes in usage: | ||
| Line 74: | Line 81: | ||
* GPT-4 Total with Buffer: $262.50 * 1.20 = $315.00 | * GPT-4 Total with Buffer: $262.50 * 1.20 = $315.00 | ||
== Conclusion == | === Conclusion === | ||
* Estimated Monthly Cost:{{break}} | * Estimated Monthly Cost:{{break}} | ||
* Using GPT-4 (8K context): Approximately $315.00 per month | * Using GPT-4 (8K context): Approximately $315.00 per month | ||
{{imbox | |||
| type = style | |||
| image = [[Image:Talking-2.png|80px]] | |||
| style = width: 600px; | |||
| textstyle = color: black; font-weight: bold; font-style: italic; | |||
| text = All this is to say that a couple of bucks/month each is enough. | |||
}} | |||
Latest revision as of 08:08, 5 November 2024
AI comes at costs: that's is why
The AI Business Model
Dear User,
now that we've gotten excited about new technologies, let's move on to the sour notes.
AI comes at a cost.
OpenAI provides its service by charging on a pay-as-you-go basis.
Below you can see a breakdown of the cost based on the fact that we have about 2,500 users and (assuming) 10 percent of those users have a desire (or need) to interact with AI.
The short version:
in the scenario I just outlined (10% of users using the AI Assistant) it takes 315$ per month (284€ at today's exchange rate).
We therefore have two possible scenarios:
a) we give up providing this feature (due to lack of funds)
b) we provide the service for a fee (with a donation-paywall?).
Given that our (Andy and me) agreements were to run a nonprofit site (and remain so) we must at least return expenses.
The question, then, is this: is the benefit we bring to TTA (and the traditional music world) greater with the introduction of AI, or is the nonprofit guise of TTA inescapable?
——
The long version:
to estimate the monthly cost of offering our OpenAI Assistant (TTAssist) to our subscribers, we’ll need to consider several factors:
- Model Used: The cost per token varies depending on the AI model you’re using (e.g., GPT-3.5 Turbo, GPT-4).
- Usage Volume: The number of interactions you expect per month.
- Token Consumption: The average number of tokens per interaction, including both user input and assistant response.
You can think of tokens as pieces of words, where 1,000 tokens is about 750 words.
Identify the AI Model and Pricing
I believe that the only model applicable to our needs is the GPT-4, and so I will not consider other models (such as GPT-3.5 Turbo).
As of my last update in September 2024, here are the approximate costs (please check the OpenAI Pricing page for the most recent rates):
- GPT-4 (8K context):
- $0.00500 per 1,000 tokens for input
- $0.01500 per 1,000 tokens for output
Estimate Usage Volume
Since we have 2,500 subscribers, we need to estimate how many will use the assistant and how frequently:
Active Users per Month: Let’s assume 10% of subscribers will use the assistant regularly.
- 2,500 subscribers * 10% = 250 active users
- Interactions per User per Month: Assume each active user has 10 interactions.
- 250 active users * 10 interactions = 2,500 total interactions per month
Estimate Token Consumption
An average interaction includes both the user’s question and the assistant’s response:
User Input: ~100 tokens (about 75 words)
Assistant Response: ~200 tokens (about 150 words)
Total Tokens per Interaction: 100 (input) + 200 (output) = 300 tokens
Calculate Monthly Token Usage
- Total Tokens per Month: 2,500 interactions * 300 tokens = 750,000 tokens
- Input Tokens Total: 2,500 interactions * 100 tokens = 250,000 tokens
- Output Tokens Total: 2,500 interactions * 200 tokens = 500,000 tokens
Calculate Monthly Cost
For GPT-4 (8K context):
• Input Cost: (250,000 tokens / 1,000) * $0.00500 = $37.50
• Output Cost: (500,000 tokens / 1,000) * $0.01500 = $225.00
• Total Cost: $37.50 (input) + $225.00 (output) = $262.50
Add a Buffer for Variability
It’s prudent to include a buffer (e.g., 20%) to account for unexpected spikes in usage:
- GPT-4 Total with Buffer: $262.50 * 1.20 = $315.00
Conclusion
- Estimated Monthly Cost:
- Using GPT-4 (8K context): Approximately $315.00 per month
 | All this is to say that a couple of bucks/month each is enough. |