Over the years, I've seen many comments dismissing Excel. But as many people who've worked in enterprises know, Excel is a godsend for manipulating reams of data for non-programmers who can think analytically. Of course, complex formulae and extensive VBA functions become a tech debt over time. But implemented properly, it provides a solution which doesn't require huge management approvals and increases productivity.
I'm sure that these new features will find a lot of use amongst many people. And seeing these Excel innovations is heartening.
Even as a programmer I find Excel pretty useful for anything involving numbers. The fact that everything is reactive allows for very fast iteration when testing stuff.
I wouldn't necessarily want to maintain a really complicated spreadsheet but I stop using spreadsheets once it gets anywhere near "complicated". It's still valuable for what I use for.
I work at an airline where Claude is replacing data analysis tools like excel, data visualization tools like power bi, all that's left is dynatrace because it does it all automatically like Claude does. Many bespoke data processing or data analysis tools for non programmers are being replaced by Claude suscriptions, like excel, power bi, spss, tableau, those are the most used I think. No Python data analysis nor big data tools like pandas, numpy, apache superset are being replaced though
I would argue using Claude in replacing a spreadsheet is potentially more of a tech debt than the spreadsheet itself. Now if you would use Claude to build a point application that performs the same standard analysis it might be better, but only marginally so.
The other aspects is the new generation doesn't understand it. During interviews in marketing but also for a medical field expert, I often ask "make a small budget so you'll see how your bonus will work", and even the PhD, which is the top academic level, couldn't use a basic formula. How do they deal with data during a PhD? "In Prism", she said.
Same for marketing students and, although it's a lower academic level, they still need Excel for prospect lists.
Recent grads at all levels always suffer from this problem. The issue is they’ve not needed to use it with enough frequency in their academic lives to build the knowledge or muscle memory. Things have improved a lot in past 10 years or so, but it’s even true with many Finance and Accounting grads (that’s who I hire). Many of them just have never seen real world business data and working with it so different than the contrived information they had seen in coursework. That said give them $15 to spend on Udemy. Then, give them a few assignments, with real world business data. And most people pick it up pretty quickly.
What would be a revolution in excel is if we could have probability distributions in cells. Right now all spreadsheets are fairly deterministic and we think that tells us something about the real world. Having an ability to make cells distributions (and then all resultant cells would be distributions too) would represent the uncertainty in the world better (and expose lots of interesting things like distributions of tails)
Guesstimate (https://getguesstimate.com) has been around for years. I assumed Excel and Google would incorporate its features quickly, but it never seems to have taken off.
Features:
- All cells are named (auto named if you don't set them)
- Cells can have single values, many types of probability distribution, or sample data
- Formulas also produce distributions as first class outputs, because calculation is a Monte Carlo sim
- Each cell also has a pop-up box that invites you to explain your reasoning -- built in documentation
It got so much right. Sample data particularly useful because you can build a probabilistic bottom-up forecast and then update it with real-world data.
What would this look like? Whenever I need something like that, I just stick each parameter in its own cell and use functions from there.
I would love an easier way to communicate to tech/math-illiterate CEOs that worst case, average case, and best case are different things, but must all be planned for.
When I did Process Improvement we used MiniTab for this.
I honestly was not a fan of that program and would have loved to be able to use Excel, but there are so many statistical things you just can't do in it.
> This library solves that problem. It registers xarray data structures as custom JAX PyTrees. This allows JAX to seamlessly flatten xarray objects into their raw arrays for accelerated computation and then unflatten the results back into fully labeled xarray objects, preserving critical metadata like dimension names and coordinates.
flatten and unflatten with datatypes is necessary for unrolling loops for performance.
Which is the correct logic for probabilistic logic, for expressions with frequentist or symbolic distributions as values? Are quantum logic and quantum statistical mechanics the appropriate or useful tools for all probabilistic logic?
dist_a1 <operator> dist_a2
uncertainties does mean±dev in Python with numpy types.
> W3C CSVW supports per-column schema. ( with URIs for datatypes )
> Serialize a dict containing a value with uncertainties and/or Pint (or astropy.units) and complex values to JSON, then read it from JSON back to the same types. Handle datetimes, complex values, and categoricals
IEEE-754 specifies NaN (null), ±0, three infinities (positive, negative, and unsigned), but IEEE-754 does not specify a representation for categoricals, datetimes (like ISO8601), or complex numbers.
XSD (XML Schema Datatypes), which RDFS vocabularies often use to specify the rdfs:range of an rdfs:Property, does not specify how to specify abstract complex numbers; but OpenMath RDF, and QUDT (Quantities, Units, Dimensions, and Types) and OM Ontology all have a way to save complex numbers to disk, too.
The matrix product is not something specific to matrices, but it is a particular case of the contracted tensor product.
(While now almost everybody uses the names "tensor product" and "contracted tensor product", historically these names are wrong. Better names, which do not misuse the word "tensor", would have been "Zehfuss product" and "Cayley product", after the names of the mathematicians who have introduced them.)
The word "tensor" has become increasingly corrupted over the years. Originally, it had a meaning that matched its etymology, i.e. "tensor" meant "symmetric matrix", because a matrix could be decomposed through the polar decomposition into a tensor and a versor (i.e. a symmetric matrix and a rotation matrix).
Then what is now called tensor theory was created by Ricci, but without ever using the word "tensor". The meaning of the word "tensor" was changed by Einstein in his theory of the general relativity, where for unknown reasons he chose this word to refer to arrays with an arbitrary number of dimensions that satisfy a certain kind of transformation relationships when the systems of coordinates is changed.
After WWII, due to the huge popularity of Einstein, this weird usage of the word has become widespread.
Then for many decades tensors were just a subset of arrays, those that are changed in a certain specific way when the system of coordinates is changed.
Eventually, there was the second corruption of the word "tensor" which is completely unjustified, when "tensor" has become just a synonym for "array".
Vectors are 1-dimensional arrays (though originally, like tensors, vectors were only a subset of 1-dimensional arrays), matrices are 2-dimensional arrays and nowadays "tensors" means just "arrays", i.e. of an arbitrary dimension.
The tensor product and the contracted tensor product are defined for arrays of arbitrary dimensions. For 2-dimensional arrays the contracted tensor product is a.k.a. matrix product, and for 1-dimensional arrays it is a.k.a. scalar product.
I was skeptical, but this looks genuinely useful. I can already think of some use-cases for this, e.g. a spreadsheet I was working on recently had a list of user, and then a comma-separated list of software apps they were using. It was a bit of a nightmare to parse, but the example in the article would definitely help with filtering the list.
its been down hill ever since they broke the old meta with xlookup - this is yet another move aimed at the casual audience, designed to bring in the party gamers and makes the program a mess competitively
I imagine adding this feature has cost many hours of development. Aren't there lower-hanging fruits to please Excel's users? What about allowing user-defined shortcuts? E.g. to edit a cell it's still either the mouse or F2, neither of which is comfortable on modern laptops.
It's funny how history repeats itself... from 61 years ago:
Pick OS had multi-value fields... Not quite the same, but it was the "Excel", and so much more, at the time.
There are still 100's of organization still using MVDBs. Of those 1000's of multivalue professionals, I expect very few to peruse HN. There are dozens of us!
Why does a blog page need three loading spinners at the top to load a couple of simple text banners asynchronously?! ... And this from one of the biggest software giants. We have fallen so far.
I wouldn't consider myself a "pro" Excel user. I think my comprehension would be on the higher end of "basic", or maybe the lowest end of "intermediate".
That said, in all the years I've used spreadsheets, I guess I've never really thought I needed more than one value in a cell. I never really seriously considered putting JSON or something in there, and have been ok with just using more cells instead (especially since Office 2019 when they added dynamic arrays that allowed spillover).
Same thoughts here. The comments in here make it sounds like a good idea. But isn't the whole idea behind excel (and any spreadsheet really) to have all data flat into sheets. For me the idea alone seems to break the whole concept
I didn’t really appreciate excel fully until I worked at a company that forbid software development and had implemented a whitelist policy for executables. VBA was blocked too.
Excel on Windows was the only tool available, outside of offering sacrifices to the high priesthood of IT.
It is a supremely elegant tool capable of deep data integration and extraordinary analysis, if you approach it with an engineer’s mindset.
This was during the time when they started introducing lambda and related functions. Nowadays, Excel is even more of a superpower.
Unfortunately, Excel on Mac is not nearly as good. It has all the features, but it’s missing a lot of the UI needed to use them effectively.
I've worked at places like they. They did have a self-service app store you could use to install things. It also had an approval system for anything that cost real money for a license. Excel was the bread and butter for many engineers for a long time to make functional tools. The great part of Excel is you could make little GUIs with the tables, not exactly QT, but you could have labels and textboxes. We regularly used a tool up until 2020 that was originally created in Excel 97.
MATLAB was the runner up for our tools but the good part about Excel was that every PC had it whereas MATLAB wasn't and also needed network access for the license (or else your program/department had to buy a node license). Later, many people switched to python since not everyone loves MATLAB and it's more of a real software language (and it's free) than what's effectively a very expensive calculator.
Excel has kept many companies alive that ought to have sunk. It covers for incompetent CIOs and sclerotic management.
Blocking VBA (for security reasons) did wonders for process maturity because it forced funded implementation of programs. Now we have vibeslop we're going the other way.
Were you able to process truly large datasets? I worked at a very excel company once but we kept running into row limit issues when scaling workloads and eventually migrated almost everything away from it. What industry were you in at the time?
Aerospace. I was interacting with data sets on the order of hundreds of millions to low billions of rows. This particular company had legacy WinForms applications running against SQL Server. Excel can directly connect to the db to run complex, multi-step queries (IIRC it holds the connection open so you can do things in temp table). Hitting “Refresh” in Excel can trigger a lot of work. And then it can do a ton of processing locally. IIRC, there were no row limits on what excel could process locally (so long as the final result stayed under the sheet limit).
The same thing that works for databases also works for excel. You shard the data and run your analysis on the set of shards in excel. It's not elegant, but can solve many problems.
Within 5 years (maybe less) a frontier LLM will be capable of completely cloning Excel based on Microsoft's product documentation. And I mean starting from scratch, not using the messy Libreoffice code base.
Excel now support lists and arrays as values in a cell, but it still thinks February 29th, 1900 is a thing because 40 year-old backwards compatibility?
Is that a contradiction? Adding list and arrays doesn't break backwards compatibility. In general, guaranteeing backwards compatibility doesn't prevent you from adding new features, and having both old quirks and new features is fairly common for any decently old software
I’ve recently been experimenting with OnlyOffice as a non-excel alternative that can still support a broad formula set and I’ve been really pleasantly surprised. I want to be able to use an open source spreadsheet system and onlyoffice is surprisingly robust.
Sibling comment nailed my feeling on this: the UI of onlyoffice is modern and clean. To add on, it gives me a feeling of confidence that it can round-trip files back and forth from excel more reliably; a lot of people on my team also use excel and we need to exchange workbooks, so that was what prompted me to move on from LibreOffice when I lost confidence that files would be able to remain pretty stable going back and forth.
I’m a very occasional and casual user of office programs. Mostly I don’t use them.
What I like about OnlyOffice over LibreOffice is the UI. I like how it’s one program that can open all the documents rather than a collection of different programs as well. It feels clean, simple, and modern.
Having just learned R, it feels like Excel is feeling competitive pressure from R and so has implemented R's `lists` and `vectors` types. It will be interesting to see if it makes its way to ODS.
Lists and vectors have been around for a while. I dont think they suddenly started feeling pressure from those data structures after 30 years, coincidentally when you learnt about their existence
Also the people who would use R and who would use excel are completely different. They use both for the same thing but a user of one would rarely use the other
But treesheets isn’t used by millions of office workers across the globe. I doubt treesheets is know by 2% of the HN audience. So it just doesn’t make the news.
Or was the point you knew an obscure fact about an obscure application?
I guess “so nothing”. The model is fundamentally broken. Adding a third dimension to certain cells by giving them a new type (‘tuple’, ‘list’?) whilst also having multiple sheets that aren’t (really) addressable is a disaster for the semantics.
This really feels like jumping the shark. But I'll admit I've run into cases where this would have been handy. I wonder if it'll be worth all the inevitable edge cases and footguns it'll create.
Excel arrays are difficult to work with, exceedingly slow, and didn't have some basic formula support.
This looks like a very sane implementation, addresses some issues with traditional arrays (while extending them nicely) and implements those much-needed formulas.
> Throughout Excel's 40-year history, you've only been able to put one value per cell. In this announcement, we're excited to share how that's changing with the release of lists, arrays in cells, and nested arrays, initially to Microsoft Excel for Windows and Mac Beta Channels.
This seems like something I'd expect to already exist in Excel, but the way it's being presented makes it sound like they want to murder Excel.
Would anyone be shocked to find out that I've been smuggling JSON in spreadsheets for a long long time and regret nothing?
Users might see it as a good thing to have yet another feature, but this sort of type-softness is why Excel is bad. In general having every feature is a bad thing, you need constraints to design things, to have idioms.
Making everything flexible is what allows you to make spaghetti that nobody understands.
I shall embark upon a quest, and the quest’s object shall be thus: to define multiple lambdas within a list, and thereupon, to make cells downstream depend upon the lamda’s, and to make them in turn become lists or values, and so on, until the whole thing breaks.
Excel does not need to be as opinionated or portable as a programming language. This might actually be a lesser of two evils considering what type of user behavior it encourages. (I've heard a similar ethos behind certain design decisions of Go)
Microsoft is actively harming the laypersons comprehension of their data with 'features' such as this.
Reasoning about the basic shape of data with real estate managers using the Btrieve[0] database on DOS (and then XP) in years gone by was noticeably more straight forward than wrangling the monolithic excel monstrosities encountered today.
There is an argument to be made somewhere that Microsoft should’ve pressed much more hardly upon Access and the separation between data and operations thereupon than the conglomerate mess that is Excel.
I used to say Excel was the only truly useful, well-designed piece of software Microsoft ever made. It's an amazing example of dataflow programming and for that reason alone it's worthy of study.
Alas, Microsoft has enshittified it. Excel used to be a standalone program, then they made it online with the offline version hard to find. I bought that offline version only to discover it would stop working if it didn't phone home to the mothership every 30 days. Now (at least for my Mac version) it has stopped working entirely, even if I let it phone home.
I probably have a cause of action against Microsoft for this, but life's too short to wade into a legal battle with a sewage company and Libre Office is available and I'm switching to Linux anyway.
Hah, AI-written summary? (Using Buzzfeed's 1-sentence-per-paragraph-for-fifth-grade-reading-skills style). The author is "msexcel, Bronze Contributor", and if I click the username I get a "Cannot find current user" (1).
Anyway, adding an extra dimension on a 2-dimensional spreadsheet (rows, columns, and now depth)? Good luck with that.
(1) OK it breaks for all usernames, I guess because it's Microslop...
Not really. I get what you are saying, and with discipline you could emulate depth with sheets. But it would only be by convention and I don’t think many functions worked that way.
A quote from the Baghavad Gita on this being a bad thing, is fine. But me pointing out all the infrastructure this will likely break, and how, is not?
Is it that I complained in the way I stated something? Because fine, if that's what keeps getting your attention (this isn't the first time), I'll try to Americanise the way I talk here.
You packed a lot of things in here! Let me try to tease them apart.
> But me pointing out all the infrastructure this will likely break, and how, is not?
Of course it's fine. It's just a question of how. There were two problems with your comment: (1) it was snarky, which we're trying to avoid and which HN's guidelines ask you not do do; and (2) you didn't provide much information, so it came across as shallow. The combination of snarky and shallow is bad for the conversation we're hoping for.
It sounds like you have experience in this domain. If so, you could write an interesting comment about your experience (e.g. with spreadsheets, VBA, how they control businesses) and how the current release will break things. If you did that by adding details from your personal experience (anecdotes are king!) and avoiding snark, that would be more than fine.
Such comments, of course, take time to write. It's taken me 37 minutes and counting to write this one. (Edit: 45 minutes.) If you don't want to or don't have time, that's ok—just please refrain from snarky/shallow/indignant one-liners.
> A quote from the Baghavad Gita on this being a bad thing, is fine
It's common (and understandable) that when people see comment A going unmoderated while their own comment B is scolded by a mod, they feel singled out for unfair treatment. I've described this in the past as "it always feels like the mods are against you" (https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...).
But there's a dirt-simple explanation: we don't see everything. Not even close! There's far too much for us to see even 10% of what gets posted here. When you see a post that ought to have been moderated but hasn't been, the likeliest reason is that we didn't see it. You can always help by flagging it or emailing us at hn@ycombinator.com.
> Because fine, if that's what keeps getting your attention (this isn't the first time)
What gets my attention are comments breaking the site guidelines. It's nothing personal! I didn't remember replying to you before, though once you mentioned it, I looked it up.
It goes against every bone in my Aquarian body to regard myself as a policeman, but the analogy somewhat holds in this case. Say you get pulled over for speeding. It's easy to feel you're being singled out: what about the cars that were speeding past you? do they just get a pass? But it's not personal. Policeperson is just sitting there doing their (no doubt rather boring) highway duty.
> I'll try to Americanise the way I talk here
I gather that you perceive HN's guidelines as specifically American? I see them differently. They are an attempt at figuring out how to manage a large internet forum across national differences—and other differences—without degenerating into mutual clubbing (the caveman kind, not the dancing kind).
None of the HN moderators is American. The site was created by an American, but he was born in England and has been ensconced there for quite a while now. It's all more complex than one's assumptions imagine, and when you fire those at people, you can sting them. Even at internet distances.
I haven't seen it as personal. You're noticing me, means something I'm doing, is noticeable. Something I'm doing hits some (probably automated) flags. Just asking the question to see where I'm running into things, where I haven't in the past few years, and I'm afraid I do think this one is a cultural thing.
I mentioned America, because I'm from Australia, and our two cultures, as often as we interact, do have moments where we fizzle and pop against each other. Calling someone sir or ma'am is a service in America. In Australia, it is liable to piss off the person you're talking to. What one sees as polite, often isn't for the other.
I don't see any snark in what I've said. I see a little frustration, but I don't see any attack on anyone. Which makes it hard to judge, why one thing is acceptable, and another isn't, when they hold the same gravitas and attitude. Again, a "What did I do, exactly?" not a "why are they picking on me".
Is it that snark and sarcasm are synonyms over there? They aren't here. Probably because Australia is a very sarcastic place (e.g. "Yeah, nah").
It it that I didn't add an extra frame, to de-escalate, before saying this was going to cause problems? That is something I often see foreigners feeling the need to do, that just doesn't happen here. If something is crap, we call it crap. Especially if we built it ourselves, and in business communications and court readings as often as face to face.
I already do change my tone on HN, from what works in the home country. Seems I need to change it further.
I didn't add an anecdote for this one, simply because it is well-trodden ground. That businesses run out of Excel, and run into various problems with compatibility, has more blogposts than the site could probably host. It isn't an interesting thing.
The only interesting bit, is that this is going to ruin the days of a few people, and they already know why. My comment was just an invitation to commiserate. Adding more, would direct the conversation more towards those who would criticise and judge the process, without acknowledging the business process is probably not changeable. I don't want to start flames here. I do want to follow the guidelines, because I do agree with them. And if I didn't, I wouldn't be here.
It makes me gleeful to see Microsoft adding genuinely new and useful features to their standard products. Whether true or not, it feels like it's been such a long time..
And something that isn't AI or an advertising opportunity…
Though they have been slowly adding useful new features to Excel (auto- spill is one I occasionally find to be both a time saver and a mistake reducer) for a few years now, after a long time seemingly doing very little with it. While I'm all for things having a "done" state and after that not doing much with them so as to not break a good thing, there is plenty of room for little improvements like new functions (admittedly many of them likely a bit niche) in Excel, just as long as they don't break what already works at the same time.
I recommend you read the article. It's short, illustrated, and does a good job of explaining what's new, how it works, and how it extends existing Array functionality.
The way to do mathematics on computers is via a CAS such as Mathematica. This is misguided pornography. Unfortunately as such it shall do what its implementers intended: for a while embrace, and if not extend, embolden.
And yes, I know Wolfram Language is proprietary too, and, yes, I know Stephen Wolfram is a massive tool, and yes, I know Mathematica licenses are expensive, and yes, I am aware of probably all the criticisms you can level my way and at it and then some in various permutations thereof, but heavens, at least it isn’t this dissolute disaster otherwise known as Excel, where “numbers have a place” but they don’t need to be numbers, and they don’t need to be in a place or have a place, but they break silently whilst you run your hedge fund.
EDIT: As soon as I get my hands on this monstrosity I shall embark upon a voyage to define several lambdas within the same cell as a list, and then make other cells depend upon it, and their type too, to see how far I can push this thing until it breaks.
Sure you can. It would mostly VBA and not using much of the spreadsheet part, but it's totally possible to do with native VBA code. No plug-ins needed, although you might have to cheat a bit with Win32 API calls depending on exact functionality.
Over the years, I've seen many comments dismissing Excel. But as many people who've worked in enterprises know, Excel is a godsend for manipulating reams of data for non-programmers who can think analytically. Of course, complex formulae and extensive VBA functions become a tech debt over time. But implemented properly, it provides a solution which doesn't require huge management approvals and increases productivity.
I'm sure that these new features will find a lot of use amongst many people. And seeing these Excel innovations is heartening.
Even as a programmer I find Excel pretty useful for anything involving numbers. The fact that everything is reactive allows for very fast iteration when testing stuff.
I wouldn't necessarily want to maintain a really complicated spreadsheet but I stop using spreadsheets once it gets anywhere near "complicated". It's still valuable for what I use for.
I work at an airline where Claude is replacing data analysis tools like excel, data visualization tools like power bi, all that's left is dynatrace because it does it all automatically like Claude does. Many bespoke data processing or data analysis tools for non programmers are being replaced by Claude suscriptions, like excel, power bi, spss, tableau, those are the most used I think. No Python data analysis nor big data tools like pandas, numpy, apache superset are being replaced though
I would argue using Claude in replacing a spreadsheet is potentially more of a tech debt than the spreadsheet itself. Now if you would use Claude to build a point application that performs the same standard analysis it might be better, but only marginally so.
So, Excel is just the poor man's shadow IT? I like that picture.
By the time it takes to make a custom filtered table non extensible UI for an api, the excel guy is finished three times over
I mean spreadsheets are amazing, but excel is still a shitty piece of software (in my books)
The other aspects is the new generation doesn't understand it. During interviews in marketing but also for a medical field expert, I often ask "make a small budget so you'll see how your bonus will work", and even the PhD, which is the top academic level, couldn't use a basic formula. How do they deal with data during a PhD? "In Prism", she said.
Same for marketing students and, although it's a lower academic level, they still need Excel for prospect lists.
Recent grads at all levels always suffer from this problem. The issue is they’ve not needed to use it with enough frequency in their academic lives to build the knowledge or muscle memory. Things have improved a lot in past 10 years or so, but it’s even true with many Finance and Accounting grads (that’s who I hire). Many of them just have never seen real world business data and working with it so different than the contrived information they had seen in coursework. That said give them $15 to spend on Udemy. Then, give them a few assignments, with real world business data. And most people pick it up pretty quickly.
A PhD is not for teaching about specific software tools, and hopefully even less so about legacy software from the 80's.
If you want people to be able to use Excel or service a mechanical typewriter, you need to spend extra effort to teach them.
What would be a revolution in excel is if we could have probability distributions in cells. Right now all spreadsheets are fairly deterministic and we think that tells us something about the real world. Having an ability to make cells distributions (and then all resultant cells would be distributions too) would represent the uncertainty in the world better (and expose lots of interesting things like distributions of tails)
Guesstimate (https://getguesstimate.com) has been around for years. I assumed Excel and Google would incorporate its features quickly, but it never seems to have taken off.
Features:
- All cells are named (auto named if you don't set them)
- Cells can have single values, many types of probability distribution, or sample data
- Formulas also produce distributions as first class outputs, because calculation is a Monte Carlo sim
- Each cell also has a pop-up box that invites you to explain your reasoning -- built in documentation
It got so much right. Sample data particularly useful because you can build a probabilistic bottom-up forecast and then update it with real-world data.
Wow, this is incredibly cool. I can't believe this stuff hasn't been ported into Excel.
What would this look like? Whenever I need something like that, I just stick each parameter in its own cell and use functions from there.
I would love an easier way to communicate to tech/math-illiterate CEOs that worst case, average case, and best case are different things, but must all be planned for.
Its a paid add-on but @Risk gives the functionality you're looking for
When I did Process Improvement we used MiniTab for this.
I honestly was not a fan of that program and would have loved to be able to use Excel, but there are so many statistical things you just can't do in it.
Would those then be tensors?
Matrices are Tensors but with the matrix product operator instead of the tensor product operator.
Pandas supports MultiIndex DataFrames but the pandas docs recommend xarray for 3D and N-Dimensional data.
xarray supports N-Dimensional data as for example NetCDF but not tensor arithmetic.
xarray_jax: https://github.com/google-deepmind/xarray_jax :
> This library solves that problem. It registers xarray data structures as custom JAX PyTrees. This allows JAX to seamlessly flatten xarray objects into their raw arrays for accelerated computation and then unflatten the results back into fully labeled xarray objects, preserving critical metadata like dimension names and coordinates.
flatten and unflatten with datatypes is necessary for unrolling loops for performance.
Which is the correct logic for probabilistic logic, for expressions with frequentist or symbolic distributions as values? Are quantum logic and quantum statistical mechanics the appropriate or useful tools for all probabilistic logic?
dist_a1 <operator> dist_a2
uncertainties does mean±dev in Python with numpy types.
From https://news.ycombinator.com/item?id=41411280 :
> W3C CSVW supports per-column schema. ( with URIs for datatypes )
> Serialize a dict containing a value with uncertainties and/or Pint (or astropy.units) and complex values to JSON, then read it from JSON back to the same types. Handle datetimes, complex values, and categoricals
IEEE-754 specifies NaN (null), ±0, three infinities (positive, negative, and unsigned), but IEEE-754 does not specify a representation for categoricals, datetimes (like ISO8601), or complex numbers.
XSD (XML Schema Datatypes), which RDFS vocabularies often use to specify the rdfs:range of an rdfs:Property, does not specify how to specify abstract complex numbers; but OpenMath RDF, and QUDT (Quantities, Units, Dimensions, and Types) and OM Ontology all have a way to save complex numbers to disk, too.
The matrix product is not something specific to matrices, but it is a particular case of the contracted tensor product.
(While now almost everybody uses the names "tensor product" and "contracted tensor product", historically these names are wrong. Better names, which do not misuse the word "tensor", would have been "Zehfuss product" and "Cayley product", after the names of the mathematicians who have introduced them.)
The word "tensor" has become increasingly corrupted over the years. Originally, it had a meaning that matched its etymology, i.e. "tensor" meant "symmetric matrix", because a matrix could be decomposed through the polar decomposition into a tensor and a versor (i.e. a symmetric matrix and a rotation matrix).
Then what is now called tensor theory was created by Ricci, but without ever using the word "tensor". The meaning of the word "tensor" was changed by Einstein in his theory of the general relativity, where for unknown reasons he chose this word to refer to arrays with an arbitrary number of dimensions that satisfy a certain kind of transformation relationships when the systems of coordinates is changed.
After WWII, due to the huge popularity of Einstein, this weird usage of the word has become widespread.
Then for many decades tensors were just a subset of arrays, those that are changed in a certain specific way when the system of coordinates is changed.
Eventually, there was the second corruption of the word "tensor" which is completely unjustified, when "tensor" has become just a synonym for "array".
Vectors are 1-dimensional arrays (though originally, like tensors, vectors were only a subset of 1-dimensional arrays), matrices are 2-dimensional arrays and nowadays "tensors" means just "arrays", i.e. of an arbitrary dimension.
The tensor product and the contracted tensor product are defined for arrays of arbitrary dimensions. For 2-dimensional arrays the contracted tensor product is a.k.a. matrix product, and for 1-dimensional arrays it is a.k.a. scalar product.
I was skeptical, but this looks genuinely useful. I can already think of some use-cases for this, e.g. a spreadsheet I was working on recently had a list of user, and then a comma-separated list of software apps they were using. It was a bit of a nightmare to parse, but the example in the article would definitely help with filtering the list.
The next step is to allow adding a spreadsheet into a cell, and introduce infinite zoom
https://support.microsoft.com/en-us/excel/insert-an-object-i...
I wonder what impact this will have on the World Championship of Excel
https://excel-esports.com/
its been down hill ever since they broke the old meta with xlookup - this is yet another move aimed at the casual audience, designed to bring in the party gamers and makes the program a mess competitively
Is copy-paste still broken in Excel after that "security update"?!
https://www.windowslatest.com/2026/09/17/microsoft-kb5002914...
I imagine adding this feature has cost many hours of development. Aren't there lower-hanging fruits to please Excel's users? What about allowing user-defined shortcuts? E.g. to edit a cell it's still either the mouse or F2, neither of which is comfortable on modern laptops.
Even more basic stuff like scrollbars that work sensibly, and not trying to second-guess what I type into a cell.
It's funny how history repeats itself... from 61 years ago: Pick OS had multi-value fields... Not quite the same, but it was the "Excel", and so much more, at the time.
https://en.wikipedia.org/wiki/Pick_operating_system
I guess I am dating myself!
There are still 100's of organization still using MVDBs. Of those 1000's of multivalue professionals, I expect very few to peruse HN. There are dozens of us!
> I guess I am dating myself!
at least you never have to worry about who pays
Why does a blog page need three loading spinners at the top to load a couple of simple text banners asynchronously?! ... And this from one of the biggest software giants. We have fallen so far.
About time! Should have done this from the start instead of spill. That and being able to index into the multiple values in a cell.
Reminds me of Oppenheimer: "Now I am become Death, the destroyer of worlds"
it's the Baghavad Gita, which Oppenheimer quoted. there's a wikipedia link...
https://en.wikipedia.org/wiki/Bhagavad_Gita#/media/File:Trin...
When I read this post earlier, I immediately thought, "don't cross the streams."
Your scientists were so preoccupied with whether or not they could, they didn't stop to think if they should.
nooo Oppenheimer, you prevented needless world war
by having nukes we prevent world war 3, see british operation unthinkable
Interesting.
I wouldn't consider myself a "pro" Excel user. I think my comprehension would be on the higher end of "basic", or maybe the lowest end of "intermediate".
That said, in all the years I've used spreadsheets, I guess I've never really thought I needed more than one value in a cell. I never really seriously considered putting JSON or something in there, and have been ok with just using more cells instead (especially since Office 2019 when they added dynamic arrays that allowed spillover).
This seems like it'd be some sort of April Fools announcement.
Same thoughts here. The comments in here make it sounds like a good idea. But isn't the whole idea behind excel (and any spreadsheet really) to have all data flat into sheets. For me the idea alone seems to break the whole concept
I didn’t really appreciate excel fully until I worked at a company that forbid software development and had implemented a whitelist policy for executables. VBA was blocked too.
Excel on Windows was the only tool available, outside of offering sacrifices to the high priesthood of IT.
It is a supremely elegant tool capable of deep data integration and extraordinary analysis, if you approach it with an engineer’s mindset.
This was during the time when they started introducing lambda and related functions. Nowadays, Excel is even more of a superpower.
Unfortunately, Excel on Mac is not nearly as good. It has all the features, but it’s missing a lot of the UI needed to use them effectively.
I've worked at places like they. They did have a self-service app store you could use to install things. It also had an approval system for anything that cost real money for a license. Excel was the bread and butter for many engineers for a long time to make functional tools. The great part of Excel is you could make little GUIs with the tables, not exactly QT, but you could have labels and textboxes. We regularly used a tool up until 2020 that was originally created in Excel 97.
MATLAB was the runner up for our tools but the good part about Excel was that every PC had it whereas MATLAB wasn't and also needed network access for the license (or else your program/department had to buy a node license). Later, many people switched to python since not everyone loves MATLAB and it's more of a real software language (and it's free) than what's effectively a very expensive calculator.
Excel on Mac does not have all the features. It does have most of them. It is also buggy.
Excel has kept many companies alive that ought to have sunk. It covers for incompetent CIOs and sclerotic management.
Blocking VBA (for security reasons) did wonders for process maturity because it forced funded implementation of programs. Now we have vibeslop we're going the other way.
Were you able to process truly large datasets? I worked at a very excel company once but we kept running into row limit issues when scaling workloads and eventually migrated almost everything away from it. What industry were you in at the time?
Aerospace. I was interacting with data sets on the order of hundreds of millions to low billions of rows. This particular company had legacy WinForms applications running against SQL Server. Excel can directly connect to the db to run complex, multi-step queries (IIRC it holds the connection open so you can do things in temp table). Hitting “Refresh” in Excel can trigger a lot of work. And then it can do a ton of processing locally. IIRC, there were no row limits on what excel could process locally (so long as the final result stayed under the sheet limit).
The same thing that works for databases also works for excel. You shard the data and run your analysis on the set of shards in excel. It's not elegant, but can solve many problems.
The console in browsers is also very useful
Especially since it uses your cookies by default.
> Unfortunately, Excel on Mac is not nearly as good. It has all the features, but it’s missing a lot of the UI needed to use them effectively.
Someone could just vibe code that. I'm not even kidding.
You underestimate the task by multiple orders of magnitude. It would be a significant effort even to build it on libreoffice.
Within 5 years (maybe less) a frontier LLM will be capable of completely cloning Excel based on Microsoft's product documentation. And I mean starting from scratch, not using the messy Libreoffice code base.
That seems pretty wild to me
Wonder if it works with all the functions - most of which would assume one value
Excel now support lists and arrays as values in a cell, but it still thinks February 29th, 1900 is a thing because 40 year-old backwards compatibility?
This is a strange world we live in.
Backwards compatibility with Lotus 1-2-3: https://learn.microsoft.com/en-us/troubleshoot/microsoft-365...
Is that a contradiction? Adding list and arrays doesn't break backwards compatibility. In general, guaranteeing backwards compatibility doesn't prevent you from adding new features, and having both old quirks and new features is fairly common for any decently old software
I’ve recently been experimenting with OnlyOffice as a non-excel alternative that can still support a broad formula set and I’ve been really pleasantly surprised. I want to be able to use an open source spreadsheet system and onlyoffice is surprisingly robust.
Are you familiar with LibreOffice? Are there any advantages that OnlyOffice has over other open source spreadsheets?
Sibling comment nailed my feeling on this: the UI of onlyoffice is modern and clean. To add on, it gives me a feeling of confidence that it can round-trip files back and forth from excel more reliably; a lot of people on my team also use excel and we need to exchange workbooks, so that was what prompted me to move on from LibreOffice when I lost confidence that files would be able to remain pretty stable going back and forth.
I’m a very occasional and casual user of office programs. Mostly I don’t use them.
What I like about OnlyOffice over LibreOffice is the UI. I like how it’s one program that can open all the documents rather than a collection of different programs as well. It feels clean, simple, and modern.
Same thing
Having just learned R, it feels like Excel is feeling competitive pressure from R and so has implemented R's `lists` and `vectors` types. It will be interesting to see if it makes its way to ODS.
Lists and vectors have been around for a while. I dont think they suddenly started feeling pressure from those data structures after 30 years, coincidentally when you learnt about their existence
Also the people who would use R and who would use excel are completely different. They use both for the same thing but a user of one would rarely use the other
This is a huge change, but it's unfortunate they left out types. Imagine if they had Haskell style list pattern matching and pure function evaluation.
Treesheets had this for over 15 years now. https://strlen.com/treesheets/
But treesheets isn’t used by millions of office workers across the globe. I doubt treesheets is know by 2% of the HN audience. So it just doesn’t make the news.
Or was the point you knew an obscure fact about an obscure application?
Same applies to many of the more elaborate usages of Excel I'd argue. Only few dive deep
I suppose it shows that it's not an outright innovation in this space, for whatever that is worth.
And Lotus Improv ‘solved’ spreadsheets about thirty-five years ago. So?
So?
I guess “so nothing”. The model is fundamentally broken. Adding a third dimension to certain cells by giving them a new type (‘tuple’, ‘list’?) whilst also having multiple sheets that aren’t (really) addressable is a disaster for the semantics.
Excel is a fractal of bad design
This really feels like jumping the shark. But I'll admit I've run into cases where this would have been handy. I wonder if it'll be worth all the inevitable edge cases and footguns it'll create.
Did you? Isn't the whole point of of excel to just make a new sheet if you have a another form of data structure?
Excel just got a z-axis. Cool.
They already had that with 3D formulas. (Not even kidding... you can sum the same range across multiple spreadsheet tabs)
Weird, because I remember a job where we had arrays in Excel cells back in 2008.
Excel arrays are difficult to work with, exceedingly slow, and didn't have some basic formula support.
This looks like a very sane implementation, addresses some issues with traditional arrays (while extending them nicely) and implements those much-needed formulas.
You could call a named range or ctrl+shift+enter to run an array command. You couldn't put a defined array in a single cell, it would read at text.
These arrays are IN A SINGLE CELL
> Throughout Excel's 40-year history, you've only been able to put one value per cell. In this announcement, we're excited to share how that's changing with the release of lists, arrays in cells, and nested arrays, initially to Microsoft Excel for Windows and Mac Beta Channels.
This seems like something I'd expect to already exist in Excel, but the way it's being presented makes it sound like they want to murder Excel.
Would anyone be shocked to find out that I've been smuggling JSON in spreadsheets for a long long time and regret nothing?
I have, at the risk of being a meme, put spreadsheets in cells via OLE. It was glorious.
Can you extract values from the embedded spreadsheets to do math in the host sheet?
What was that syntax like?
Some day maybe excel will be a proper database. Anyway, who uses Excel?
The real question is if Google Sheets will get these features.
Users might see it as a good thing to have yet another feature, but this sort of type-softness is why Excel is bad. In general having every feature is a bad thing, you need constraints to design things, to have idioms.
Making everything flexible is what allows you to make spaghetti that nobody understands.
I shall embark upon a quest, and the quest’s object shall be thus: to define multiple lambdas within a list, and thereupon, to make cells downstream depend upon the lamda’s, and to make them in turn become lists or values, and so on, until the whole thing breaks.
If you've got five minutes, you'll be able to crash their Python integration. Probably without trying to do so.
won't you get nested arrays not supported? or maybe you thunk it out, idk
I’m pretty sure I can make it recurse.
Excel does not need to be as opinionated or portable as a programming language. This might actually be a lesser of two evils considering what type of user behavior it encourages. (I've heard a similar ethos behind certain design decisions of Go)
The flexibility of Excel is a lot of its value. If it wasn’t flexible like this then how could it be so widespread as a general purpose business tool?
Excel allows and embraces whatever mess you want to make.
Microsoft is actively harming the laypersons comprehension of their data with 'features' such as this.
Reasoning about the basic shape of data with real estate managers using the Btrieve[0] database on DOS (and then XP) in years gone by was noticeably more straight forward than wrangling the monolithic excel monstrosities encountered today.
[0]https://en.wikipedia.org/wiki/Btrieve
There is an argument to be made somewhere that Microsoft should’ve pressed much more hardly upon Access and the separation between data and operations thereupon than the conglomerate mess that is Excel.
Does it support dates from before January 1, 1900? (No)
Sigh.
I used to say Excel was the only truly useful, well-designed piece of software Microsoft ever made. It's an amazing example of dataflow programming and for that reason alone it's worthy of study.
Alas, Microsoft has enshittified it. Excel used to be a standalone program, then they made it online with the offline version hard to find. I bought that offline version only to discover it would stop working if it didn't phone home to the mothership every 30 days. Now (at least for my Mac version) it has stopped working entirely, even if I let it phone home.
I probably have a cause of action against Microsoft for this, but life's too short to wade into a legal battle with a sewage company and Libre Office is available and I'm switching to Linux anyway.
This would violate 1NF in SQL.
Codd wept.
- 404? https://techcommunity.microsoft.com/blog
But can I use multiple slurp juices on a single cell?
Excel gone SIMD
Now add 2D lists...
Hah, AI-written summary? (Using Buzzfeed's 1-sentence-per-paragraph-for-fifth-grade-reading-skills style). The author is "msexcel, Bronze Contributor", and if I click the username I get a "Cannot find current user" (1).
Anyway, adding an extra dimension on a 2-dimensional spreadsheet (rows, columns, and now depth)? Good luck with that.
(1) OK it breaks for all usernames, I guess because it's Microslop...
Is https://techcommunity.microsoft.com/blog/microsoft365insider... better? We could swap the URLs.
Edit: I swapped the URLs.
You already had sheets in the workbook for depth
I’d like to be able to make a cell into a sheet… like a subsidiary schedule
Not really. I get what you are saying, and with discipline you could emulate depth with sheets. But it would only be by convention and I don’t think many functions worked that way.
Index does at least, which is pretty huge.
Oh great. More stuff to break the two decade piplelines in the poorly maintained VBA-scripted and now AI-infested sheets that control businesses.
"Don't be snarky."
"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something."
https://news.ycombinator.com/newsguidelines.html
Not really sure on this, dang.
A quote from the Baghavad Gita on this being a bad thing, is fine. But me pointing out all the infrastructure this will likely break, and how, is not?
Is it that I complained in the way I stated something? Because fine, if that's what keeps getting your attention (this isn't the first time), I'll try to Americanise the way I talk here.
You packed a lot of things in here! Let me try to tease them apart.
> But me pointing out all the infrastructure this will likely break, and how, is not?
Of course it's fine. It's just a question of how. There were two problems with your comment: (1) it was snarky, which we're trying to avoid and which HN's guidelines ask you not do do; and (2) you didn't provide much information, so it came across as shallow. The combination of snarky and shallow is bad for the conversation we're hoping for.
It sounds like you have experience in this domain. If so, you could write an interesting comment about your experience (e.g. with spreadsheets, VBA, how they control businesses) and how the current release will break things. If you did that by adding details from your personal experience (anecdotes are king!) and avoiding snark, that would be more than fine.
Such comments, of course, take time to write. It's taken me 37 minutes and counting to write this one. (Edit: 45 minutes.) If you don't want to or don't have time, that's ok—just please refrain from snarky/shallow/indignant one-liners.
> A quote from the Baghavad Gita on this being a bad thing, is fine
It's common (and understandable) that when people see comment A going unmoderated while their own comment B is scolded by a mod, they feel singled out for unfair treatment. I've described this in the past as "it always feels like the mods are against you" (https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...).
But there's a dirt-simple explanation: we don't see everything. Not even close! There's far too much for us to see even 10% of what gets posted here. When you see a post that ought to have been moderated but hasn't been, the likeliest reason is that we didn't see it. You can always help by flagging it or emailing us at hn@ycombinator.com.
> Because fine, if that's what keeps getting your attention (this isn't the first time)
What gets my attention are comments breaking the site guidelines. It's nothing personal! I didn't remember replying to you before, though once you mentioned it, I looked it up.
It goes against every bone in my Aquarian body to regard myself as a policeman, but the analogy somewhat holds in this case. Say you get pulled over for speeding. It's easy to feel you're being singled out: what about the cars that were speeding past you? do they just get a pass? But it's not personal. Policeperson is just sitting there doing their (no doubt rather boring) highway duty.
> I'll try to Americanise the way I talk here
I gather that you perceive HN's guidelines as specifically American? I see them differently. They are an attempt at figuring out how to manage a large internet forum across national differences—and other differences—without degenerating into mutual clubbing (the caveman kind, not the dancing kind).
None of the HN moderators is American. The site was created by an American, but he was born in England and has been ensconced there for quite a while now. It's all more complex than one's assumptions imagine, and when you fire those at people, you can sting them. Even at internet distances.
I haven't seen it as personal. You're noticing me, means something I'm doing, is noticeable. Something I'm doing hits some (probably automated) flags. Just asking the question to see where I'm running into things, where I haven't in the past few years, and I'm afraid I do think this one is a cultural thing.
I mentioned America, because I'm from Australia, and our two cultures, as often as we interact, do have moments where we fizzle and pop against each other. Calling someone sir or ma'am is a service in America. In Australia, it is liable to piss off the person you're talking to. What one sees as polite, often isn't for the other.
I don't see any snark in what I've said. I see a little frustration, but I don't see any attack on anyone. Which makes it hard to judge, why one thing is acceptable, and another isn't, when they hold the same gravitas and attitude. Again, a "What did I do, exactly?" not a "why are they picking on me".
Is it that snark and sarcasm are synonyms over there? They aren't here. Probably because Australia is a very sarcastic place (e.g. "Yeah, nah").
It it that I didn't add an extra frame, to de-escalate, before saying this was going to cause problems? That is something I often see foreigners feeling the need to do, that just doesn't happen here. If something is crap, we call it crap. Especially if we built it ourselves, and in business communications and court readings as often as face to face.
I already do change my tone on HN, from what works in the home country. Seems I need to change it further.
I didn't add an anecdote for this one, simply because it is well-trodden ground. That businesses run out of Excel, and run into various problems with compatibility, has more blogposts than the site could probably host. It isn't an interesting thing.
The only interesting bit, is that this is going to ruin the days of a few people, and they already know why. My comment was just an invitation to commiserate. Adding more, would direct the conversation more towards those who would criticise and judge the process, without acknowledging the business process is probably not changeable. I don't want to start flames here. I do want to follow the guidelines, because I do agree with them. And if I didn't, I wouldn't be here.
This is a valid and well considered comment. It’s not your role to police opinion, dang.
Quite! And fortunately I don't know what the opinion is.
It turns out that, with practice, you can read comments along one axis and not another. And boy do we practice.
It’s good for the economy.
It makes me gleeful to see Microsoft adding genuinely new and useful features to their standard products. Whether true or not, it feels like it's been such a long time..
And something that isn't AI or an advertising opportunity…
Though they have been slowly adding useful new features to Excel (auto- spill is one I occasionally find to be both a time saver and a mistake reducer) for a few years now, after a long time seemingly doing very little with it. While I'm all for things having a "done" state and after that not doing much with them so as to not break a good thing, there is plenty of room for little improvements like new functions (admittedly many of them likely a bit niche) in Excel, just as long as they don't break what already works at the same time.
So they added support for and a nice UI on JSON data types in database fields.
That may sound reductive and dismissive, but I think that's actually pretty cool and likely to make some things a lot easier.
I didn't read this, but it could already hold tons of values in one cell? Can someone explain what they are 'supporting' now?
I recommend you read the article. It's short, illustrated, and does a good job of explaining what's new, how it works, and how it extends existing Array functionality.
The way to do mathematics on computers is via a CAS such as Mathematica. This is misguided pornography. Unfortunately as such it shall do what its implementers intended: for a while embrace, and if not extend, embolden.
And yes, I know Wolfram Language is proprietary too, and, yes, I know Stephen Wolfram is a massive tool, and yes, I know Mathematica licenses are expensive, and yes, I am aware of probably all the criticisms you can level my way and at it and then some in various permutations thereof, but heavens, at least it isn’t this dissolute disaster otherwise known as Excel, where “numbers have a place” but they don’t need to be numbers, and they don’t need to be in a place or have a place, but they break silently whilst you run your hedge fund.
EDIT: As soon as I get my hands on this monstrosity I shall embark upon a voyage to define several lambdas within the same cell as a list, and then make other cells depend upon it, and their type too, to see how far I can push this thing until it breaks.
I'm sure someone has already coined a law something like this:
The use of Excel expands until it fills the space of all use cases.
To my knowledge, you still can't write an email client in Excel.
OK, maybe with plug-ins, but probably not natively.
Probably not.
Maybe.
Sure you can. It would mostly VBA and not using much of the spreadsheet part, but it's totally possible to do with native VBA code. No plug-ins needed, although you might have to cheat a bit with Win32 API calls depending on exact functionality.
In a rigid lattice, aye.