have you looked at the new GPT-3 stuff?
Lol. You don't understand what mathematics fundamentally is. You don't get to make that claim
Yes. It is the exact same shit. All of the stuff since BERT has just been making transformers bigger. No actual innovation in how they operate or how they perform. It's just adding more compute and is not a tenable path forward
someone allegedly in the industry saying this makes me very sad 
also are you seriously hired to find SOTA cost function for transformers? i thought the important part was just finding a ton of data. i hope the DoD has its hiring priorities straight.
1 Like
You clearly don't understand how it works. The datasets for NLP are widely available and accessible. Novel training systems and model architectures are what matters when the organization you work for has massive amounts of data. Stop fucking talking about shit you don't understand
yes. but the apparent power of the new model makes makes upscaling look a lot more promising.
will you claim it"doesnt actually understand" no matter how good it is at what it does?
does your model outperform GPT-3?
1 Like
No, it does not at all if you know anything about transformer models for NLP, they don't actually work very well. They have zero understanding and have massive generalization error problems.
On the tasks it was designed for, yes.
Does civilian spendibg increase when the stock market is doing well regardless of whether or not that individual is rich or poor regardless of investments?
My tips have been absolutely laughable in the last few days
putting aside the specific model, would you ever admit a AI NLP has "understanding"?
I made $31 per hour my last pay period and now I'm getting fucked
We are very busy but nobody is tipping
This somehow was missed. I donât accept the bullshit narrative:
..^ that is âactually dangerous and destructiveâ
So donât twist my words.
No, because they absolutely have no understanding. Watch this talk for the reasons explaining why
I disagree
AI is actually dumber than most people know
are you claiming AI NLP will never have understanding on metaphysical grounds? or are the way they are constructed now just not implementing it?
Verging on dad joke territory jdance.
I guess thatâs probably a good sign.
Watch the video.