Remix.run Logo
colonial 5 days ago

> A note on our fair-use policy

> Basically our policy states that you can use AI models based on your plan’s value.

Although I likely won't use Assistant, stuff like this is why I love Kagi. My relationship with them as a customer feels refreshingly transparent; I can't think of any other consumer SaaS provider that automatically answers my reflexive "how does this make money?" question.

(Compare, say, Discord. It's best in class, but eternally unprofitable - which makes me wary that it might fold or go to hell at the drop of a hat.)

basch 4 days ago | parent | next [-]

The thing still giving me pause is a lack of "bring your own model connection" between saas uh services.

If I already pay for Gemini Advanced (or OpenAI/ChagtGPT Pro), I then have to pay for it again at every service that offers a Pro 2.5 (or 4.1/4o) tier. I should be able to connect my Gemini Advanced access to any service that offers Flash and be able to upgrade. Signing up for a bunch of services is starting to feel like being triple, quadruple or more dipped. Similar to how I am annoyed seeing media content cross licensed to three streaming services and not getting a bill reduction when subscribed to multiple services with the same content.

eightysixfour 4 days ago | parent | next [-]

I really feel like the software model is going to start to break in a couple of ways in the near future.

Instead of vertical software slices, many people are going to want their single “horizontal” agent that they pay for (e.g Gemini Advanced, Claude) and connectivity to all of their other services.

MCP (which I personally think is a mediocre protocol, so it will probably win) as the glue for a bunch of services we OAUTH against and choose when our agents do/do not have access to certain tools.

The idea of a “GPT” App Store from OpenAI was sort of right, but just wrong enough. We are going to have an App Store inside of our preferred AI platform and subscribe/connect our other services from there.

basch 4 days ago | parent | next [-]

I prefer identity as the top layer. Give me an identity portal that acts as an account manager, access to api layer, let me perform password resets, and let me avoid 2fa if I’m logged into my identity manager account. It should allow bidirectional control: both what services have access to my identity, and what services anything in my identity are granted access to access. Things like LLM, cloud storage etc should be obscured away from services so they can’t tell my storage providers from one another. All access between services should cascade down from my identity portal.

orand 4 days ago | parent | next [-]

Who is going to pay for identity as a product and not just expect it as a free feature of another product suite?

basch 4 days ago | parent [-]

Why not both? Use Apple or Microsoft or a third party identity provider.

jcgl 4 days ago | parent | prev [-]

I mean, that sounds basically like Oauth provided by the LLM provider, right? The provider just needs to build out the features.

siva7 4 days ago | parent | prev | next [-]

No question, the openai gpt marketplace/store was a birth failure and doesn't make much sense in hindsight anymore. I just don't understand why they don't pull the plug and admit it's a failure.

heywoods 4 days ago | parent | prev [-]

Your intuition regarding the shift from vertical to horizontal integration is spot on!

Sam Altman, in a recent Stratechery interview, detailed parts of OpenAI's future strategy that align with your prediction — a persistent, personalized AI. He envisions users interacting with OpenAI not just through core products but also across other applications.

Altman described a key part of the strategy: "...we have this idea that you sign in with your OpenAI account to anybody else that wants to integrate the API, and you can take your bundle of credits and your customized model and everything else anywhere you want to go".

This system aims to create a portable AI experience and by virtue, would usurp the vertical software business model that has historically dominated the software economy. A horizontal play, that sits in the middle collecting their tidy sum of the pot will require a very compelling argument. That would require a low barrier to integrate for developers coupled with a value-add proposition that is meaningful and not possible for anyone other than the largest technology companies.

As you know, it’s sort of the Wild West of tech right now. OpenAI is looking to find a territory in the AI landscape and make their stake now, and I think this is the correct strategy. We have seen what being the first to market with a great product can do for the longevity and growth of tech companies - especially the consumer markets. They have the name recognition, forever embedded in the lexicon of the internet, and a great product vision that will lead to critical mass adoption that and what awaits them is the coveted moat, at least in the consumer market, that AI companies have been struggling to find out in the Wild West of AI.

Altman mentioned wanting users to "be able to sign in with your personal AI that's gotten to know you over your life". This sign-in would ideally carry "your memory and who you are and your preferences and all that sort of thing" across different integrated services.

The OpenAI SSO login will be the Trojan horse and later on the app developers will either be incentivized by OpenAI or compelled to integrate their products because of the compelling value proposition it would bring to bare with an integrated personalized AI assistant, complete with its memory and preferences.

Lastly, I suspect this is one of the driving motivations to become a consumer hardware company as there is little to no chance that current players (Apple, Google, Meta) would allow the same 1st party access to their internal API’s would be a requirement for what Altman has laid out for OpenAI moving forward.

freehorse 4 days ago | parent | next [-]

I understand we some may want that, but why should everybody else want that? I operate in several contexts. I want some kind of models in one context and one in another. I want the AI to be contextualised within each use, not “personalised” on me. Yeah sure it would be great if it had memory within some project, but I would rather not have memory between projects or use cases that are irrelevant to each other.

esafak 4 days ago | parent | prev [-]

The industry solution to this is to create an open standard for AI memory.

everforward 4 days ago | parent | prev [-]

I doubt that fits in the usage model for those pricing plans. They're priced assuming it's inconvenient and less used because of it. I keep hearing they're losing money anyways, so despite being triple or quadruple dipped you're still paying less than it costs to run the models.

basch 4 days ago | parent | next [-]

How would it cost Kagi anything, if I bring my own keys and all the costs are offloaded to my personal Google/ChatGPT account? I pay them the $10/month and get the Unlimited Pro access (but only to models I subsidize the cost of.) If anything it would save them money to offload my usage to my account vs using up some of their Flash tier quota.

It would be ideal for them for LLM access portability to let them offer higher end models and have the end consumer pay directly for the usage.

Id much rather pay for one AI License, and a small fee to each service I use, rather than paying a high tier AI Bonus price at every single service.

macrocosmos 4 days ago | parent [-]

I think they might be talking about the cost to the model providers.

basch 4 days ago | parent [-]

Then Google should offer Advanced Portable for $30 that includes being able to plug it into third party services. With some kind of policing to prevent it from being used as the entire backend to a service (for all users) itself.

everforward 4 days ago | parent [-]

Third party usage is too disparate for a single flat rate to make sense. Perplexity probably uses orders of magnitude more tokens than Kagi does (the former uses tokens on every search, the latter only does if you manually invoke the Assistant).

Then there's the disparity in how many third party services each user uses. Some will use one, some will use 50. Google could charge per integration, but that's basically the status quo.

basch 4 days ago | parent [-]

Why would the number of integrations be the price point and not token tiers? I might want to connect my account to 100 services to test them, but only perform a couple uses each before forgetting about it.

everforward 4 days ago | parent [-]

I agree that makes sense, but it makes potential subscribers to the third parties nervous. I like Kagi Assistant because my payment is capped.

I get nervous plugging my pay-as-you-go API keys into random software because of the risk they rack up a $1000 bill doing something I wouldn’t have paid $20 for them to do.

The other three things are that economies of scale make it cheaper for Kagi to buy a bajillion tokens, Google et al don’t want to manage the customer side of things (what service ate how many tokens?), and service providers don’t want you seeing their “magic” in your console. Seems like there’s a lot of power in the system instruction side of things, and Perplexity probably doesn’t want you seeing their prompt.

basch 4 days ago | parent [-]

So let me lock it down. When I add the key, let me tell my provider this service is allowed 3% of my capacity before it’s locked out.

yellowapple 2 days ago | parent | prev [-]

> I keep hearing they're losing money anyways

Hearing from whom?

weird-eye-issue 5 days ago | parent | prev | next [-]

I've paid for a monthly subscription with Discord for years

They also have ads in the app and they have other monetization features...

colonial 5 days ago | parent [-]

Revenue != profit. Discord, like almost every 2010s SaaS startup, has revenue (from your Nitro) - but not nearly enough to cover expenses.

troupo 5 days ago | parent | next [-]

> Revenue != profit

And for over a decade most companies talk only about revenue, which is infuriating. Because most startups and tech darlings survive only by continuous infusion of unlimited investor money.

inglor 5 days ago | parent | next [-]

I worked for 4 startups that were operating for years at a loss with revenue, all are profitable today and all were acquired.

My current startup is also not profitable, we're burning money but we're already signing big contracts and I hope in a year or two we keep growing rather than become profitable (1B+ valuation in a year).

Becoming profitable, even at this point is just a matter of deciding to stop expanding - but neither us nor our investors want this given there is so much potential for growth and more revenue streams on the line.

this is ycombinator's news aggregators, I suspect you're not going to get a "don't take risks and build things" vibe - it's a startup accelerator after all :).

troupo 5 days ago | parent [-]

> all are profitable today and all were acquired.

They are either profitable or acquired :)

> Becoming profitable, even at this point is just a matter of deciding to stop expanding

Yeah, growth at all costs is one of the defining factors.

> it's a startup accelerator after al

The only business models for Y Combinator startups are:

- run indefinitely long on unlimited investor money

- get sold to the highest bidder at some nebulous market valuation

Becoming profitable never enters the picture :)

sebastiennight 5 days ago | parent [-]

> They are either profitable or acquired :)

Why? Once a company has been acquired, does it automatically fall out of profitability?

If it's acquired in a stock sale, it remains an independent entity and still has a P&L

If it's acquired/merged in an asset sale (not usually a good sign), it can still be assessed whether the new division is profitable - except in some rare cases like Google (allegedly!) not wanting to itemize some of their divisions to avoid too much regulatory scrutiny on monopoly positions.

> Becoming profitable never enters the picture :)

Seems very wrong based on looking at YC's portfolio, which apparently includes a bunch of profitable startups

troupo 5 days ago | parent [-]

> Once a company has been acquired, does it automatically fall out of profitability?

It becomes a part of the company that bought it?

> Seems very wrong based on looking at YC's portfolio, which apparently includes a bunch of profitable startups

It contains very few profitable startups. Those are the exceptions.

sebastiennight 4 days ago | parent [-]

> It becomes a part of the company that bought it?

Not necessarily. As I explained above, most successful acquisitions are stock sales, in which case the acquiring company now owns the startup (they hold the shares). The startup is still a separate entity at this point.

Google is known for just merging the acquired startups into their product line (and/or killing them), but it's not a hard rule that all acquisitions are mergers.

For example, AFAIK Livestream is still a subsidiary of Vimeo (ie wholly owned, but separate): https://en.wikipedia.org/wiki/Vimeo_Livestream

So Livestream can be profitable or not, separately from whether its acquirer is.

lukas099 5 days ago | parent | prev [-]

> most startups and tech darlings survive only by continuous infusion of unlimited investor money.

Investors making long bets is a good thing, I’d argue.

troupo 4 days ago | parent [-]

The bets are invariably: sell to the highest bidder, exit through inflated IPO and/or speculative "market capitalization".

There are a few outliers like "let's subsidize this price dumping until all competitors are dead and then we recoup money by being a de facto monopoly"

weird-eye-issue 5 days ago | parent | prev | next [-]

They are profitable

And besides my point was that it's pretty clear what their monetization is and that it's not some mystery

RadiozRadioz 5 days ago | parent [-]

> They are profitable

Citation needed. With this type of company and business model, it's highly unusual to be profitable, so the burden of proof is on those who say it is.

raphman 5 days ago | parent | next [-]

They are apparently not profitable (yet):

> Discord has raised a total of about $1 billion in funding. It has more than $700 million in cash on its balance sheet and the goal to become profitable this year, according to a person familiar with the matter.

https://www.theverge.com/2024/1/11/24034705/discord-layoffs-...

4 days ago | parent [-]
[deleted]
ltbarcly3 5 days ago | parent | prev [-]

[flagged]

gchamonlive 5 days ago | parent | next [-]

People shouldn't add insult to injury. Just because someone failed to do proper research and documentation doesn't make it ok for others to make the same mistake. People should lead by example, not by shunning.

ltbarcly3 5 days ago | parent [-]

[flagged]

4 days ago | parent [-]
[deleted]
weird-eye-issue 5 days ago | parent | prev [-]

> I can't think of any other consumer SaaS provider that automatically answers my reflexive "how does this make money?" question.

My reply was in response to the above quote and not whether they are currently profitable or not. Besides, a company being profitable at this very moment is actually not that relevant in the long term.

lotsofpulp 5 days ago | parent [-]

> Besides, a company being profitable at this very moment is actually not that relevant in the long term.

It’s pretty relevant, especially for a business that is 9 years old, and has no hardware R&D/manufacturing component.

7bit 5 days ago | parent | prev [-]

Not enough to cover expenses? Do you understand what you're saying? That they're running a deficit for 15 years. Companies must make profit, or they vanish. They clearly make a profit, otherwise they would no longer exist.

inglor 5 days ago | parent | next [-]

They raise more capital and get more debt and try to lower burn rate but the original comment was talking about the 2010s mindset of "growth before profit" where you want more users/revenue to get acquired by a bigger player that can better monetize you.

The fact Discord isn't profitable (and hasn't been) is well documented.

Also, operating at a loss isn't necessarily bad (i.e. if you expand or spend more on R&D your profits shrink). Companies might choose to spend more on R&D and not be profitable (e.g. Amazon for a long time).

MrJohz 5 days ago | parent | prev | next [-]

I'm not a business person, so take this with a grain of salt, but my understanding is that this is common for a lot of smaller startups and tech companies.

If you can raise funds outside of revenue (i.e. outside of directly selling your products), you can keep operating even if you're not actually generating any income directly. Typically that will be in the form of investment and loans. So even if your expenses (incl. repayments for outstanding loans etc) are higher than your revenue, you can stay in business as long as you can convince enough investors that it's still worth their while to give you their money.

I don't know whether this is true for Discord specifically, but I understand it's a fairly common strategy, especially for companies where their best chance of success is by being the only player in a given market.

Zetaphor 4 days ago | parent | prev | next [-]

It took Uber 15 years to make their first profit

https://www.theverge.com/2024/2/8/24065999/uber-earnings-pro...

weird-eye-issue 4 days ago | parent | prev | next [-]

This is particularly an ironic comment given that this is the forum run by a company that invests in companies that are not yet profitable and are often not profitable for years if ever

kerkeslager 5 days ago | parent | prev | next [-]

> Companies must make profit, or they vanish.

Oh, buddy. That's how it's supposed to work, but that is not how it works at all.

an_guy 4 days ago | parent [-]

What do you mean?

kerkeslager a day ago | parent [-]

Companies can exist for decades without making a profit, as long as they can keep borrowing money.

The strategy here is often just trying to operate at a loss longer than your competition. If your competition finally can no longer borrow, you buy them up and have a monopoly on the market, allowing you to price gouge.

There are other reasons a lender might lend to a perpetually-unprofitable company. For example, you might lend to a company to maintain a competitor who doesn't really compete, in order to avoid a monopoly breakup, or lend to a holding company that holds product with no intention to sell it, in order to maintain artificial scarcity (i.e. housing, diamonds).

Note that in none of these examples are you competing to provide the best products at the lowest prices.

sevg 5 days ago | parent | prev [-]

This is a big misconception (though not one I’m used to seeing in the HN crowd).

Companies can operate at a deficit for many years without vanishing, usually because they have venture capital funding or investor backing.

manquer 4 days ago | parent | prev | next [-]

Having a good ethos before significant funding rounds is one thing , it is lot harder once you raise a ton of external money.

It is not big bad VC either, VC funding while demanding is still lot more forgiving than Private equity or public markets . It is nature of a free economy to be as efficient as possible which in turn makes it affordable and accessible to class of users who would not have been do so before .

4 days ago | parent | prev [-]
[deleted]