John Schulman on Twitter: "Certain software skills are exceptionally useful for machine learning. In a previous era, it was GPU programming. Now in the era of pretrained models, it's front-end development -- to quickly whip up a UI to collect a fine-tuning or eval dataset." / Twitter
I think the ability to quickly explore different data strategies informed by experimenting with the task-strategies (say the end user experience) will be key to new innovations.