Played with ChatGPT a little tonight. Interesting.
I talked to it briefly about stock trading. It would only reply in generalities. It would not make any specific recommendations.
I then started talking to it about making hard cider and beer. It gave me some pretty credible recipes for cider, American Pale Ale, IPA, and British Dark Mild Ale. It successfully scaled those recipes to different volumes, and intelligently discussed using different brewing equipment and methods.
I asked it about the assumed AA percentages in the Dark Mild recipe, and it replied that the EKG hops were assumed to be 5% AA and the Fuggles were assumed to be 4% AA. I then asked it what I should do if my EKG hops were only 3.5% AA. It correctly told me I'd have to adjust the hops according the the ratios of the actual and assumed values, then it went through the calculations and told me to use 0.7 oz. of EKGs instead of 1.0 oz! Uh... NO!!!
I kept trying to lead it back to the right answer, but it wouldn't fix the calculation until I actually performed the correct calculation for it.
Interestingly, every time I pointed out an error, it politely apologized to me.
So, it was pretty good, but not perfect.