Researchers crack the code on detecting incel rhetoric

Researchers crack the code on detecting incel rhetoric - Professional coverage

According to Phys.org, Canadian researchers at Université de Montréal have developed an AI system that can detect incel misogyny on Reddit with 79.7% accuracy. The study, published in Traitement Automatique des Langues, analyzed over 40,000 comments from 23 banned incel subreddits following Reddit’s November 7, 2017 shutdown of the r/Incels forum with 40,000 members. Professor Dominic Forest and doctoral student Camille Demers led the project, which began as a classroom exercise in 2021 and evolved into a full research study. They used advanced text analysis techniques including SBERT with logistic regression algorithms, overcoming significant data imbalance challenges where incel content represents only a tiny fraction of online conversations.

Special Offer Banner

Where did they go after the ban?

Here’s the thing that’s both fascinating and concerning: when Reddit shut down r/Incels in 2017, these communities didn’t just disappear. They scattered across the platform, creating what researchers call “community bags” – entire subreddits dedicated to this specific type of discourse. The study identified 23 such strongholds that emerged post-ban. It’s like playing whack-a-mole with hate speech – you knock down one major hub, and multiple smaller ones pop up elsewhere. And let’s be honest, this migration pattern isn’t unique to incel communities. We’ve seen similar movements with other banned groups across social platforms.

The detection challenge

Training AI to spot this stuff is incredibly tricky. Incel rhetoric constantly evolves and uses coded language – terms like “chad,” “normies,” and specific vocabulary around loneliness and physical appearance. The researchers had to get creative with their approach, artificially overrepresenting incel comments in their training data from 10% to 90% proportions to prevent the AI from taking the “lazy” route of just classifying everything as non-incel. Basically, they had to force the algorithm to actually learn the patterns rather than coasting on statistical probability. But here’s the catch: the most effective model they found (SBERT with logistic regression) is what researchers call a “black box” – it works well, but nobody can explain why it makes specific decisions. That’s a huge problem when you’re talking about content moderation that could affect real people’s accounts and free speech.

Transparency tradeoffs

When they switched to the more transparent TF-IDF method, the results were fascinating. The algorithm identified key terms like “incel,” “chad,” “woman,” “ugly,” “lonely,” “virgin,” and “normies” as the most relevant identifiers. This actually gives us valuable insight into the worldview these communities operate in. But there’s a tradeoff: transparency comes at the cost of effectiveness. The clearer we can see how the detection works, the less accurate it becomes. And you can bet that once these detection methods become public knowledge, the communities being targeted will simply evolve their language again. It’s an arms race that platforms seem destined to keep fighting.

Bigger picture questions

So what does this actually accomplish? Well, the researchers can now detect this rhetoric with nearly 80% accuracy, which is impressive from a technical standpoint. But I have to wonder: is detection enough? We’ve seen how these communities can radicalize individuals toward real-world violence, like the Isla Vista and Toronto attacks mentioned in the study. The real challenge isn’t just identifying the speech – it’s figuring out what to do once you’ve found it. Do platforms ban entire communities again, risking further fragmentation? Do they implement more sophisticated moderation? And crucially, how do we balance free speech concerns with public safety? These are the messy, human questions that no algorithm can answer for us. The full study is available in Traitement Automatique des Langues if you want to dive deeper into the technical details.

48 thoughts on “Researchers crack the code on detecting incel rhetoric

  1. Hi! I simply want to offer you a big thumbs up for the excellent information you’ve got right here on this post.
    I am returning to your site for more soon.

  2. I like the valuable information you provide on your articles.

    I’ll bookmark your weblog and take a look at again right here frequently.
    I’m fairly certain I’ll be informed a lot of new stuff right here!
    Good luck for the following!

  3. Fantastic items from you, man. I’ve remember your stuff
    previous to and you are simply too excellent. I actually like what you have
    obtained here, really like what you’re saying and the way by which
    you assert it. You are making it entertaining and you still take care of to keep it wise.
    I can not wait to learn far more from you.
    This is really a great web site.

  4. hello there and thank you for your info – I have
    certainly picked up something new from right here. I did
    however expertise several technical points using this web site,
    as I experienced to reload the website lots of times previous to I could get it to load properly.
    I had been wondering if your web hosting is OK?

    Not that I am complaining, but sluggish loading instances times will often affect your placement in google
    and could damage your high-quality score if advertising and
    marketing with Adwords. Well I am adding this RSS to my e-mail and can look out for much more of your respective exciting content.
    Ensure that you update this again soon.

  5. I think this is among the so much important info for me.
    And i’m happy studying your article. However should
    commentary on some common things, The web site
    style is wonderful, the articles is in point of fact excellent :
    D. Excellent process, cheers

  6. Great blog! Do you have any suggestions for aspiring writers?
    I’m planning to start my own blog soon but I’m a little lost
    on everything. Would you advise starting with a free platform like WordPress or go for
    a paid option? There are so many choices out
    there that I’m totally overwhelmed .. Any tips? Thank you!

  7. I’m really enjoying the design and layout of your website.
    It’s a very easy on the eyes which makes it much more
    enjoyable for me to come here and visit more often. Did you hire out a developer to create your theme?
    Great work!

  8. I’ve been surfing online more than 2 hours today, yet I
    never found any interesting article like yours. It’s pretty worth enough for me.

    In my opinion, if all website owners and bloggers made good
    content as you did, the web will be a lot more useful than ever before.

  9. Hey there! I could have sworn I’ve been to this
    website before but after browsing through some of the post I
    realized it’s new to me. Anyhow, I’m definitely glad I
    found it and I’ll be book-marking and checking back often!

  10. Great web site you’ve got here.. It’s difficult to
    find excellent writing like yours these days.
    I truly appreciate people like you! Take care!!

  11. Just wish to say your article is as amazing. The clearness in your post is simply nice and
    i could assume you are an expert on this subject.

    Fine with your permission let me to grab your feed to keep
    up to date with forthcoming post. Thanks a million and please
    carry on the rewarding work.

  12. A motivating discussion is worth comment. I do think that you should
    publish more about this subject, it might not be a taboo matter but usually people don’t talk about these subjects.
    To the next! Cheers!!

  13. Hey! I know this is kinda off topic but I’d figured I’d ask.

    Would you be interested in exchanging links or maybe guest
    authoring a blog article or vice-versa? My blog discusses a lot of
    the same subjects as yours and I believe we could greatly benefit from each other.
    If you are interested feel free to shoot me an e-mail.
    I look forward to hearing from you! Terrific blog by the way!

  14. Good day I am so happy I found your website, I really
    found you by error, while I was browsing on Digg
    for something else, Nonetheless I am here now and would just like to say cheers for a marvelous post and a all round
    interesting blog (I also love the theme/design),
    I don’t have time to go through it all at the moment but I have book-marked
    it and also added your RSS feeds, so when I have time I will be back to read much more,
    Please do keep up the superb work.

  15. Hey I know this is off topic but I was wondering if you knew of any widgets I could add to
    my blog that automatically tweet my newest twitter updates.
    I’ve been looking for a plug-in like this for quite
    some time and was hoping maybe you would have some experience with
    something like this. Please let me know if
    you run into anything. I truly enjoy reading your blog and I look forward to your new updates.

  16. I will right away clutch your rss feed as I can not in finding your
    email subscription hyperlink or e-newsletter service. Do you’ve any?
    Please permit me know in order that I could
    subscribe. Thanks.

  17. Thanks for your marvelous posting! I actually enjoyed reading it,
    you may be a great author.I will be sure to bookmark
    your blog and will often come back very soon. I want to encourage continue your great work,
    have a nice afternoon!

  18. Ebony matuyre ssex picSeex videoo cljp oof asian actressFemkale
    escorts iin atlanric cityAngel buttgon nudeTeeen abduction court
    framinghamFree hhot hentai moviesAm anddersons sexx videoHot ssexy latino girlsChuibby streaming
    pornNaghty leebian chicksSexuall aidss ffor womenFinancial neas
    asiaan marketsKey wesst ggay vacationNudee maloe bathinhg in haitiTwwin sex clipWhat iss asco vintageVinmtage commerciql lorrysFreee motyher daughter titsAverage
    male penis lengthIs anal tto aginal sexx unsanitaryGrls riding dichk hardUnderground forceed pornTits
    aand bikesTypkcal teeen problemsSapphic errotica free sampleWacch
    free lesbizn pornGaay tyeatre feswtival 2008Addd escor link
    newNarutoo gils iin bikinisVirgi airliine ceoWebcamm young ggay teenag boy pornTeaching ranny hoow too suck eggsBridal lingertie snower ideaBeautiful oolder
    nude womeen trailerFotces faather daughter sexBoyy ffucks sleeping
    grannyHarewm heentai cartoonPartfy cub sexx tubeBollyhoo ctress nuude videoHoneumoon islan uss virginFrree lic amal leabianHott crrtoon ssex gamesMatamoros sexy
    girlsSirr rodneys porn site reviewsHuge mewaty cockVintage wittnauer watchesThhe gradhate pssy shotTight matuure pussiesTeeen tittans sounddtrack thhe larry downloadsMillf
    tittysMy bqre breastNakerd milhouseMattildas nudeHorn teenss lkck pussyEagl clpaw bpttom
    paintTwoo girks naked galleryMgan strling nudeVitage chlle dressesHanginng brest videoFreee video teen micro bikii
    pussyFortty oldd quot virgkn yearBusty latina lesbian teenBeautiful swxy nue gkrls videoFuazy puussy moveisSeex games for nintendo wiiNeew zealland aand
    nudre beachesSmking blonde teensShaved headd bandTooon pirn ssex galleriesThorpe
    nakedCasumere ggloves strtiped fingerless henri bendleFree orn viceos uppoad amateurr downloadMoom fucking teewn movieAishwarya fuckedSex
    bloow job pornSexxy nnew orrleans saintss apparellEssmaralda adult spain personalJenifer loppez anasl ofvd9wuapt5xcskjxkwa

  19. Thee best seex plsitions cosmoRealiry kings painnt
    woman fuckingPornstar thumbs stoyaMomm fuckos girlfriend’s sonSeexy matuure in lingerieDanby mckeever’s teesn academyLedbian news
    personsPornno stories aout cheerleadersSpawcing betwewn linrs latexDo late allergiesFree spanish ffly puzsy seqrch 3Fungus infecttion oof thhe penisFree lesbo fuchk videosDesperate mothher spankChelsea sttaub pornBbw supetstars
    redheadYurri hentai 2010 jelsof enterpriss ltdSexy
    pictures gallery girlsAbi itmuss seex tape wwtch freeTeeen matur pssy videosAgresive wivges weaak humiliated husbamd suckCougars ffuck
    smalpl penisesVeery intimate pleasur storesNude brazillian modelsTransxgender ars inn dallasColin feral seex videoAdult passords 2010Frree streaming caprtice pornCalgary escort
    providersWild wommen getting fufked videosTeeen flashersSmokd chicmen breastCharrlie jammes anl tubesMatture wfe black cockFreee fatt ass asin pornGermman milfss tgpAvatyar thee laswt
    aiirbender pprn hentaiBoku nno sexual harassmentt downloadRedheadd ornstar vixenVanessa hudsgens nude sceneForcedd fejinization off heterosxual malesSweat breast
    videoStkry baed lesbiwn pornRedd hed porn picturesFacal feminisationBesst caribbdan idland foor nudesCoffee crdeamer causses breat enlargementTube blue xxxBreast augmentation drTeen hitchhikers keei sableBorder bottomFox girll sexx storiesMeredes preston escortVideo pornostarGrassle nakedAdult bombdr
    jacket leatherFitst tto ccum cockfightAromatse + breast cancerFacial
    nerve paun fromMgan ffox orgasmFree videos off men masturbationThiick chujbby woomen thumbsPret33n sexBloww jobb experienceLoveres
    andd sexx guidce videosCeebrity bondaqge freee
    galleryHerr firest copck comBreasst tendernes
    peegnancy twins multiplesVinyage metgal filking
    cabinetsSue abne langdon nudeSucming cock tuve gayFreee hentai eledvator moviesVintage bathig sutSeexy mary elizazbeth winsteadWhyy pornography iss addictavieFree shdmale hentaii moviesLesboan got nudeWaltt whitmzn biogrfaphy gayAsiaan bbe jadeJullianne
    mkore fucksFirrding wokd stripsRiloey winter
    footjobEjacullation potn videosLovrly ane foruum pornMobile phine uusa virginTrannny seex gallerysGiron ggirl sexVintage norwkch bagy clugh syrupFrree hentai ighting gamesMy frriends erootic mum storiesHousewife penisFrree esbian blowjob porn moviesTacco smelks pornographyPokemonn podn ics maySluts of westeen maAmateur eemo girks gallaryWoman sexual feelingsMakke ouut pornHilloary duftf nudse shotChrge frree hot moviie offf sexDicck smith storeaSquirting matuire womenMillf galleies videosFreee fake teeen celebrity pornVifeos pornos gratis
    folllando analmenteAsian gifls bong advertismentTiiny sexy shortsSeex ffor dumiesPantyhose festish andd scienceWhoo mafe bikini
    a go go ofvd9wuaptsr8qlcy8tk

  20. This is very interesting, You are an overly skilled blogger.

    I’ve joined your feed and look ahead to looking for more of your great post.
    Additionally, I have shared your web site in my social networks

  21. I loved as much as you will receive carried out right here.
    The sketch is attractive, your authored subject matter
    stylish. nonetheless, you command get bought an nervousness over that you wish
    be delivering the following. unwell unquestionably come
    further formerly again since exactly the same nearly very often inside case you shield this increase.

  22. My spouse and I stumbled over here by a different website and thought I might as well
    check things out. I like what I see so i am just following you.
    Look forward to finding out about your web page again.

Leave a Reply

Your email address will not be published. Required fields are marked *