Parallel Experiments
1.68K subscribers
60 photos
1 video
2 files
774 links
Stay informed. Stay authentic.

Welcome to the public part of my brain. Here I share curations and thoughts.

Created with ❤️ by @linghao.
Download Telegram
Forwarded from 啰哩啰嗦分享频道
The problem with stupidity, though, is that it often goes hand-in-hand with power. Bonhoeffer writes, “Upon closer observation, it becomes apparent that every strong upsurge of power in the public sphere, be it of a political or of a religious nature, infects a large part of humankind with stupidity.”

This works in two ways. The first is that stupidity does not disbar you from holding office or authority. History and politics are swimming with examples of when the stupid have risen to the top (and where the smart are excluded or killed). Second, the nature of power requires that people surrender certain faculties necessary for intelligent thought — faculties like independence, critical thinking, and reflection.

https://bigthink.com/thinking/bonhoeffers-theory-stupidity-evil/
https://motherduck.com/blog/big-data-is-dead/

> MOST PEOPLE DON’T HAVE THAT MUCH DATA: In order to understand why large data sizes are rare, it is helpful to think about where the data actually comes from. Imagine you’re a medium sized business, with a thousand customers. Let’s say each one of your customers places a new order every day with a hundred line items. This is relatively frequent, but it is still probably less than a megabyte of data generated per day. In three years you would still only have a gigabyte, and it would take millenia to generate a terabyte.

> WORKLOAD SIZES ARE SMALLER THAN OVERALL DATA SIZES: There are acute economic pressures incentivizing people to reduce the amount of data they process. Just because you can scale out and process something very fast doesn’t mean you can do so inexpensively. If you use a thousand nodes to get a result, that is probably going to cost you an arm and a leg. The Petabyte query I used to run on stage to show off BigQuery cost $5,000 at retail prices. Very few people would want to run something so expensive.

> DATA IS A LIABILITY: An alternate definition of Big Data is “when the cost of keeping data around is less than the cost of figuring out what to throw away.” I like this definition because it encapsulates why people end up with Big Data. It isn’t because they need it; they just haven’t bothered to delete it.
Forwarded from 推特翻译
反乌托邦文学的想象并不是凭空而来的。实际上,反乌托邦文学中想象的部分,恰恰来源于我们当今的种族主义资本主义现实中。

如果我刻薄一点,我会直接说:历史以来,反乌托邦文学就是把被边缘被歧视被压迫的人的现实生活拿过来,移到有特权的人的身上,写成的“恐怖”小说:

假如所有人都不得不移民流浪到别的的地方,不仅仅是那些第三世界的人...
假如所有人都没有生育自由,连中产白人女性都没有了生育自由...

从正面说,反乌托邦文学让那些想象力缺乏的人至少看到了被压迫的人的生活。从反面来说,被压迫的人的真实生活被虚构成了“科幻小说”,让真实的压迫反而隐身了。

这也就是为什么这本书中我选择了不去设想过度可怕的未来。因为可怕的事情在过去发生过,可怕的事情在现今还在继续发生。

—— 诗集《世界不断终结,世界继续前行》。美国作家弗兰妮·蔡。 source
https://perell.com/essay/50-ideas-that-changed-my-life/

Good mental models are immensely useful and cost effective — once you know them, they get automatically triggered in the right context.

Giving mental models good names takes this even further — it’s now impossible to forget about them. As a side note, once again I thought of this post: https://neilkakkar.com/vocabulary-mental-model.html
An excellent piece on “why RL (Reinforcement Learning) is better than learning from demonstrations (a.k.a supervised learning) for training language models”

https://gist.github.com/yoavg/6bff0fecd65950898eba1bb321cfbd81
Parallel Experiments
浅谈从 TL 到 TLM 的转变:挑战与机遇。 https://linghao.io/posts/demystifying-tlm
https://charity.wtf/2017/05/11/the-engineer-manager-pendulum/

> The best frontline eng managers in the world are the ones that are never more than 2-3 years removed from hands-on work, full time down in the trenches. The best individual contributors are the ones who have done time in management. And the best technical leaders in the world are often the ones who do both. Back and forth. Like a pendulum.
Vivid illustration of correlation!= causation 😹
https://wtfhappenedin1971.com/