| ▲ | izanton 2 hours ago |
| What if... we stop for a moment, and then, after thinking for a moment, we stop hammering nails with a microscope, and stop using token usage as a metric of productivity? I know it's sounds stupid, but what if |
|
| ▲ | symfoniq 2 hours ago | parent | next [-] |
| There is a complete lack of courage in the leadership of tech companies today, and top-down AI mandates are just another manifestation. True visionaries think outside the box, but most tech executives are forcing their employees into black boxes, out of fear of not doing exactly what their competitors are doing. We have lemmings for leaders, and that means that—much like the LLMs that are being shoehorned into everything—there isn’t room for original thinking. Everyone’s strategy looks exactly the same. |
| |
| ▲ | duxup an hour ago | parent | next [-] | | There was an amusing post about judging developers based on token usage where some user on HN here was pushing this idea “ICs don’t like it but this is the best way to evaluate” (something like that). They have a whole management team and can’t seem to find a way to judge or god forbid encourage developers… | | |
| ▲ | throwaw12 an hour ago | parent [-] | | Problem is in management, management usually comes up non-sense metric when they themselves lack of good metric. For example, everyone talks about strategy, but when you ask them what's our strategy answer is usually something like: * let's figure out together * industry changing is so fast, we should revisit plans every quarter ... | | |
| ▲ | steveBK123 30 minutes ago | parent | next [-] | | Because the higher up you go in management, the more "strategy" is a Plato's Cave like interpretation of what better/bigger/whatever competitors are doing. | |
| ▲ | doublerabbit 17 minutes ago | parent | prev [-] | | Ha. Exactly at my current contract job. "Welcome to the new contractor who will be the artitect our new infrastructure. What is your dream IT setup?" "Yeah, we can't afford that. Lets revisit once you wrangle those 2003 Dell R620's running Windows 2008 with no patching." And that is why after eight months i'm terminating my contract on Friday and swimming back to shore. |
|
| |
| ▲ | CharlieDigital an hour ago | parent | prev | next [-] | | I'm going to offer a contrarian view here: First is that despite a lot of waste, some innovation will arise from an enterprising employee finding some interesting use case. A lot of the tokenmaxxing is just waste, but out of that waste may arise a small number of genuinely powerful use cases. Second is that many workers will be entrenched in their ways. If your executive goal is to achieve the above (find innovative ways of using AI), then you need to move everyone to use it. Most will just waste tokens, but someone may find a novel and useful way of using it that benefits the organization. It is difficult to achieve these without forcing people to act since their default is to follow the well-worn grooves. So mandates like these are a top-down forcing function like a slime mold feeling out different paths to find resources. Some devs in my org have fully embraced AI; some would not even use AI if not for leadership mandates and linking usage to performance reviews (I know, I think this is stupid, too). I can see why mandates could be useful since some folks definitely won't be inclined to use AI. | | |
| ▲ | KaiserPro 38 minutes ago | parent | next [-] | | > but out of that waste may arise a small number of genuinely powerful use cases. Imagine you employ me as a hotel manager, and I come to you and say: "sure I spent all our food budget internationally in three months, and sure I have nothing really to show for it, but for those three months, we had a lot of food fights" Your manager then goes on to explain they not only need more money to cover the food budget, but also they need to quituple the cleaning budget too. Oh and the service level has dropped, because not all clients liked being in the middle of a food fight. However "we might have some innovation in the food delivery system of our hotel chain" | | |
| ▲ | CharlieDigital 35 minutes ago | parent | next [-] | | > we might have some innovation in the food delivery system of our hotel chain
This is really relative to the size of that innovation, isn't it? > Imagine you employ me as a hotel manager, and I come to you and say: "sure I spent all our food budget internationally in three months, and sure I have nothing really to show for it, but for those three months, we had a lot of food fights"
This is exactly how startups and VC funding works, isn't it? You have an idea, give you cash to burn to prove the idea and business model. Many teams and ideas fail. But some small number of unicorns produce outsized returns to keep the whole thing going. | |
| ▲ | HDThoreaun 10 minutes ago | parent | prev [-] | | Imagine you employ me as a hotel manager, and I come to you and say: "sure I spent all our food budget internationally in three months, but we invented this new dish and now our restaurant is the hottest in town. Sure 95% of the food was wasted but now we can stop the waste and keep the popular dish." |
| |
| ▲ | throwaw12 an hour ago | parent | prev | next [-] | | > some innovation will arise Absolutely, but most management are not leaders, the moment someone pushes the idea to stack rank based on token usage, it gets approved and some genuine people will be impacted. Post-ZIRP era proved there are very few strong leaders, before that everyone was behaving like they're most amazing leader because they read some books and raised $10M | |
| ▲ | vasco 32 minutes ago | parent | prev [-] | | > A lot of the tokenmaxxing is just waste, but out of that waste may arise a small number of genuinely powerful use cases A lot of monkeys will also eventually type up Shakespeare? |
| |
| ▲ | justinparus an hour ago | parent | prev | next [-] | | Is keeping your company private the easiest way to get around this? | |
| ▲ | overfeed 2 hours ago | parent | prev | next [-] | | > Everyone’s strategy looks exactly the same. If one is a CxO who's looking out for one's job security, herd-like behavior is the safest option, due to the (near universal) structure of "performance"-based executive remuneration. | |
| ▲ | AdrianB1 an hour ago | parent | prev [-] | | Lacking not just courage, but also character. Wasting company money on buzzwords and dubious outcomes is lack of character. |
|
|
| ▲ | Lalabadie 2 hours ago | parent | prev | next [-] |
| You're now in the last frame of the comic, getting thrown out the window. |
| |
| ▲ | swed420 2 hours ago | parent [-] | | Maybe it's time we adopt/design an economic system that isn't so easily co-opted by counterproductive prisoner's dilemmas. | | |
| ▲ | nradov 2 hours ago | parent | next [-] | | What would such an economic system look like? | | | |
| ▲ | robocat an hour ago | parent | prev [-] | | Go ahead and start from the small and grow it bigger: you could become a billionaire if you succeed. | | |
| ▲ | chowells 30 minutes ago | parent [-] | | Hahahaha.... What if the goal of an economic system was to support everyone instead of maximizing the upside for winners? Perhaps that's the sort of change necessary for improvement. Perhaps having billionaires is the failure state. |
|
|
|
|
| ▲ | blitzar 2 hours ago | parent | prev | next [-] |
| If there are any tech CEOs out there reading, I can offer my services. I will pointlessly burn unfathomable amounts of tokens, in parallel, 24 hours a day, 7 days a week, all for you. Think big big big numbers of tokens, you know whats cooler than a trillion tokens, a quadrillion tokens. Lets talk my bonus, I will open the bidding at $1 per token. |
|
| ▲ | tekno45 2 hours ago | parent | prev | next [-] |
| Not very Billion Dollar Valuation of you. |
| |
|
| ▲ | Aurornis an hour ago | parent | prev | next [-] |
| > and stop using token usage as a metric of productivity I participate in some management-focused online communities. It’s crazy how many threads there are from frustrated managers trying to get their teams to stop thinking that their token use will be used as a proxy for their performance. I think a few dumb companies did this and then it spread across social media, triggering a mass panic from engineers afraid their companies will be doing the same thing. It’s getting so bad that the conversation is shifting to how to identify and coach the token-maxxers to stop wasting the team’s budget every week. |
| |
| ▲ | throwaw12 36 minutes ago | parent [-] | | > managers trying to get their teams to stop thinking that their token use will be used as a proxy for their performance. Because it is going to happen. Do you think metrics are tracked for fun? Even if current leaders don't do it, next people might do it, how do you tell new leaders that we don't look at this metric? Metric exists to take action based on it |
|
|
| ▲ | icepush 17 minutes ago | parent | prev | next [-] |
| Sounds to me like you are advocating the decimation of the technology sector and a global recession that could last the better part of a decade, buddy! |
|
| ▲ | 99954bb63ccc 2 hours ago | parent | prev | next [-] |
| I feel like individually, if you sat down with literally any reasonable person on the planet they would arrive at and/or agree with the tenor here. I'd be curious to hear from people well versed in group psychology/dynamics and/or just a lot of leadership/people experience: what leads people to this type of thinking once they get in a group setting? It just... seems endemic at this point. Obviously nobody here is going to know what I do or don't know, but I'm just increasingly curious what I am not understanding about this type of thing. It seems so obvious, yet that makes me ever more suspect that I'm oversimplifying it, or just totally ignorant about the problem in general. |
| |
| ▲ | mike_hearn 2 hours ago | parent | next [-] | | It's because the average organization has lots of people who don't care about their own productivity and won't adopt new tools or processes unless forced to. This is true of most new tech - lots of workers had to be forced into using computers - but AI also has some other bumps to cross like lots of people who tried early models and then wrote them off, not realizing how fast they'd improve. And most orgs have no infrastructure or processes for allocating individuals token budgets, and most employees have no experience of properly deploying budgets. Roll it all together and saying "just use it dammit" has some obvious advantages: 1. It's clear. 2. It's simple. 3. It eliminates all excuses employees might come up with for not using it. The people at the top of these companies aren't stupid. They might have miscalculated how many tokens people can actually use, but that's very hard to calculate because usage is opaque and tools/processes change on a nearly weekly basis. They will eventually build out processes, tools, social conventions and performance metrics that take into account efficiency of token usage. But this is hard! Most managers aren't really assessed on the precise productivity of their teams, for instance, because productivity is often poorly defined. | |
| ▲ | KaiserPro 17 minutes ago | parent | prev | next [-] | | we are going through our second AI transformation, the first one didn't work that well because the tools were shit. Whats happening now and whos driving it is interesting. The CEO has a license for this new tool (think one of the top 4, Qwen Claude, Gemini, openAI) and really likes it. So much so that they (non coder) are making lots of little single page web apps. The COO is bollocks deep in AI, and is saying that we cannot buy any SaaS products anymore. We must make it ourselves. The engineering manager has seen this as an opportunity to build out a brand for engineering (its a small department in a medium sized company) by delivering quickly what the large year long efforts cant. This has formed a slopnexus where PoCs are spun up left right and centre, but there isn't much time or thought going in to making them sustainable. What started out as a (simple ish) asset management tool, neatly scoped into a deliverable PoC has morphed into a 5 product as one monster. Its a mess that will either lead to burn out or disaster. | |
| ▲ | overfeed an hour ago | parent | prev | next [-] | | > what leads people to this type of thinking once they get in a group setting Game theory! The downside of being brave vastly outweighs the upside. For the C-suite, there is no cost to herdlike-behavior, regardless of the outcome. However, there is a very high personal downside to being a maverick, and your board later discovers you made the wrong choice against the grain. The upside of being maverick and right is very limited. Once a behavior has become mainstream, hopping on the bandwagon is no longer individually attributable to decision-makers, but is seen (and reported) as a macro-economic phenomenon: Nadella, Zuckerberg and Bezos didn't overhire - the American tech industry overhired. | |
| ▲ | turzmo 2 hours ago | parent | prev | next [-] | | Won’t be canned for going with the herd. I think it’s that simple, even if the herd is running off a cliff. | |
| ▲ | themafia 40 minutes ago | parent | prev [-] | | This is a consequence of elements of monopoly power existing in your organization. When you don't have to compete for income you honestly forget how. Then the company becomes a cargo cult of bad ideas driven by managers struggling to differentiate themselves. |
|
|
| ▲ | stusmall 2 hours ago | parent | prev | next [-] |
| That was a fun thought experiment while I waited for my ralph wiggum to finish running. Now thinking is over and back to the vibe |
|
| ▲ | devin 2 hours ago | parent | prev | next [-] |
| The people who have ascended to leadership positions are deeply divorced from reality. "It is difficult to get a man to understand something, when his salary depends on his not understanding it." -Upton Sinclair |
| |
| ▲ | lorecore 2 hours ago | parent | next [-] | | The crazy thing is their salary does not actually benefit from riding these trends. Unless it's equally/even more clueless board level pressure with ulterior motives (i.e., lifting their other AI investments or the sector as a whole). | | |
| ▲ | transitorykris an hour ago | parent | next [-] | | I deeply believe this but have no strong evidence. Revenue has always been a cure all remedy. This will keep model providers alive along with the very wide range of companies that are experiencing growth with them (from chips to backhoes), for a time anyway. If/when that house of cards starts going in the other direction there’s going to be widespread pain. By analogy the nonsense of the dotcoms and that crash had a very direct impact on their suppliers (e.g. telecoms). My only advice is to let the Microsoft’s and Meta’s do the tokenmaxxing, and don’t get suckered into the idea you (startup, individual, etc) should be playing that game. | |
| ▲ | repeekad 2 hours ago | parent | prev [-] | | Every c suite in the country is panicking about being left behind, from their perspective it’s either token max or fade into obscurity, or at least that’s what they were sold | | |
| ▲ | sandeepkd an hour ago | parent | next [-] | | its a herd mentality, its a lot easier to follow the louder voices than to spend time understanding how it impacts your own particular business. Because google does this way, or apple does this way is a common argument in lot of feature/business decisions | |
| ▲ | treis 2 hours ago | parent | prev | next [-] | | Please. These are the same people that force their employees to use Microsoft teams because slack is $5 an employee a month. They're not going to sit idly by while employees burn thousands a month in tokens. | | |
| ▲ | devin 2 hours ago | parent [-] | | It depends on which people you're referring to. The allocation toward AI budget has been so massive that I think a lot of businesses are way behind on trying to assess value for dollar for the AI-related crud they're shelling out for. | | |
| ▲ | treis 2 hours ago | parent [-] | | Everyone is feeling it out but the vast majority of spend has been subscription based. Some outliers may have used a massive amount of tokens but companies didn't pay for that. That VC funded gravy train is likely coming to an end. But fortunately there are also reasonably efficient models now so that the tokenmaxxers can still make the (much cheaper) tokens go brrrr. |
|
| |
| ▲ | lorecore 2 hours ago | parent | prev [-] | | I don't think that's accurate. I think every C suite in the country is looking to do away with labor's leverage as much as possible. I think this is a cultural thing more than anything else, C suite + investors looking to get rid of those pesky humans required to prop up their lifestyles. AI is the most credible path toward that. Short, medium or long term returns be damned, this is a reconfiguration of society and they want to shed what they consider to be baggage. | | |
| ▲ | devin 2 hours ago | parent [-] | | Like anything it's a mixed bag. I am certainly working with people who I think truly believe the "max out on AI usage or become irrelevant" line. There are people who will privately let you know they're just working with the current meta the best way they can, but others who are drunk on kool aid. Trying to operate as a rational, thinking person in a lot of environments right now feels impossible. Rational thought is being treated like AI skepticism. |
|
|
| |
| ▲ | pera 2 hours ago | parent | prev [-] | | They get paid for saying whatever VCs want to hear and now that thing is "we have now become an AI-native company". The thing I'm still trying to understand is who is scamming whom | | |
| ▲ | nradov an hour ago | parent [-] | | Uber is publicly traded. They're not beholden to VCs any more. |
|
|
|
| ▲ | zeroonetwothree 2 hours ago | parent | prev [-] |
| Come on, don’t be crazy |