My take on generative AI is really not any different than my take on the current AI landscape in general; people (even otherwise smart ones) are missing the bigger picture. Current high-quality AI models have 2 very important direct factors and one important indirect factor: They are "expensive" They are trained on existing data-sets There are very few top-tier models available at any given point in time 1 - "Expensive" Models To start, I put "expensive" in quotes because they are not only costly in terms of compute power, but also still quite specialized in terms of skill in coming up with new approaches, knowing how best to select training and test data. This is the direct cause of point #3 which is more indirect, but I'll cover why that is important in a bit. The key thing being that training a top-tier model is not something most companies can afford today. Beyond stating that, there isn't much else to cover here. 2 - Trained on Existing Data T...
Blog for my misc/non-dev content