Chris Brockett
Dissident. NLP data janitor. Tsundoku expert. Transient epiphanies. Language, computation and cognition. Personal account: opinions are not my employer's.
Last synced from Twitter 7m ago
Negated LAMA: Birds cannot fly
Pretrained language models have achieved remarkable improvements in a broad
range of natural language processing tasks, including question answering (QA).
To analyze pretrained language model performance on QA, we extend the LAMA
(Petroni et al.,...
More South Korean academics caught naming kids as co-authors
The practice was probably used to improve the children’s chances of securing a university place.
Washington officials lay out case for 'game-changing' bullet train linking Vancouver, Seattle, Portland
Chris Brockett
If Morocco can have this sort of thing, why can't we? (Maybe we could ask France for a loan?)
43h
Stephen Miller's private emails just got leaked. And they're explosive.
Miller promoted white nationalists, cited a racist novel, and praised a eugenicist president.
E.P.A. to Tighten Limits on Science Used to Write Public Health Rules
A new agency rule would restrict the science that can be used in drafting health regulations by requiring researchers to turn over confidential health data.
New EPA Science Restrictions Would Devastate Public Health and Environmental Protections
New EPA Science Restrictions Would Devastate Public Health and Environmental Protections
Chris Brockett
The Trump regime's dismantling of the administrative state continues apace. This will make it almost impossible to document the health impacts of pollutants of all kinds.
3d
Re-imagining developer productivity with AI-assisted tools
Visual Studio IntelliCode is revolutionizing developer productivity. We are expanding the application of artificial intelligence to accelerate learning and radically improve developer productivity.
Chris Brockett
A cool use of the GPT-2 transformer architecture to suggest automated code completions
3d
r/MachineLearning - [P] DialogPT: State of the Art Conversational Model with Fine-Tuned GPT-2 (Microsoft Research)
70 votes and 53 comments so far on Reddit
Chris Brockett
It's fun to see that people are not having too much difficulty running their own decoders on this model. Some nice (SFW) examples have been posted on Reddit.
3d
Today Is The First Day In History Where It Forgot To Rain Across The WHOLE Of Australia
There has been no rain today on Mainland Australia for the first time in history. The unusual reading had the Bureau of Meteorology teams scratching their heads. “The team can’t comprehensively identify a day in our records where there hasn’t been...
The Dangerous Acceptance of Donald Trump
If Trump came to power, there is a decent chance that the American experiment would be over.
African AI Experts Get Excluded From a Conference—Again
For the second year in a row, researchers from the developing world have been denied visas to a major AI conference in Canada.
AI and Compute
Since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.5 month doubling time (by comparison, Moore's Law had an 18 month doubling period).
What could go wrong? Redmond researchers release a blabbering bot trained on Reddit chats
But you're going to have to insert a decoder yourself as Microsoft's left the safety on this tech
Research Intern - Natural Language Processing in Redmond, Washington, United States | Research at Microsoft
Apply for Research Intern - Natural Language Processing job with Microsoft in Redmond, Washington, United States. Research at Microsoft
1
Chris Brockett
We are hiring a scintillating new cohort of PhD student interns to work with the NLP group at Microsoft Research AI in Redmond in the summer of 2020. This is a great small team, working on lots of fun==challenging projects in the NLP space.
8d
12 Words from the Wrong Side of the Law
Crime doesn't pay, but vocabulary might
Comparing Forced-Choice and Select-All Online Survey Responses
when designing an online survey questionnaire, there is more than one way to ask a respondent to select which options in a series applies to them.
microsoft/DialoGPT
Large-scale pretraining for dialogue. Contribute to microsoft/DialoGPT development by creating an account on GitHub.
3
Chris Brockett
Our team has released a GPT-2 style model for dialog:
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
Draft paper: arxiv.org/abs/1911.00536
Github: github.com/microsoft/Dial…
9d
Domain Adaptive Text Style Transfer
Dianqi Li, Yizhe Zhang, Zhe Gan, Yu Cheng, Chris Brockett, Bill Dolan, Ming-Ting Sun. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing...
America’s Electronic Voting System is Corrupted to the Core
By Jennifer Cohn @jennycohn1
September 7, 2019