Abstract Artificial neural networks have emerged as computationally plausible models of human language processing. A major criticism these is that the amount training data they receive far exceeds humans during learning. Here, we use two complementary approaches to ask how models’ ability capture fMRI responses sentences affected by data. First, evaluate GPT-2 trained on 1 million, 10 100 or billion words against an benchmark. We consider 100-million-word model be developmentally in terms...

One reason pretraining on self-supervised linguistic tasks is effective that it teaches models features are helpful for language understanding. However, we want pretrained to learn not only represent features, but also use those preferentially during fine-turning. With this goal in mind, introduce a new English-language diagnostic set called MSGS (the Mixed Signals Generalization Set), which consists of 20 ambiguous binary classification test whether model prefers or surface generalizations...

Epidemiological and experimental studies suggest that a disease-aggravating neuroinflammatory process is present at preclinical stages of Alzheimer's disease. Given individuals with Down syndrome are increased genetic risk disease therefore develop the spectrum neuropathology in uniform manner, they constitute an important population to study evolution neuroinflammation across continuum. Therefore, this cross-sectional study, we characterized brain inflammatory profile lifespan syndrome....

Yian Zhang, Alex Warstadt, Xiaocheng Li, Samuel R. Bowman. Proceedings of the 59th Annual Meeting Association for Computational Linguistics and 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.

Abstract Artificial neural networks have emerged as computationally plausible models of human language processing. A major criticism these is that the amount training data they receive far exceeds humans during learning. Here, we use two complementary approaches to ask how models’ ability capture fMRI responses sentences affected by data. First, evaluate GPT-2 trained on 1 million, 10 100 or billion words against an benchmark. We consider 100-million-word model be developmentally in terms...

The corticoreticulospinal tract (CReST) is a descending motor pathway that reorganizes after corticospinal (CST) injury in animals. In humans, the pattern of CReST innervation to upper limb muscles has not been carefully examined healthy individuals or with CST injury. present study, we assessed projections an arm and hand muscle on same side body chronic stoke subjects using transcranial magnetic stimulation. We show connection strength differs between stroke subjects, stronger connections...

To estimate the public health impact from restricting US retail point-of-sale (POS) tobacco product displays and advertising.

The destruction of the World Trade Center (WTC) towers on 11 September 2001 released many tons aerosolized dust and smoke with potential for carcinogenic exposures to community members as well responders. WTC Environmental Health (WTC EHC) is a surveillance treatment program diverse population (“Survivors”), including local residents workers, present in NYC disaster area 9/11 or days weeks following. We report case series cancers identified EHC 31 December 2019. Descriptive characteristics...

(1) Background: Recent studies have reported elevated risks of multiple cancers in the World Trade Center (WTC) affected community members (also called WTC “Survivors”). The large variety WTC-cancers created a need to develop comprehensive cancer database. This paper describes development pan-cancer database at Environmental Health (EHC) Data Center. (2) Methods: A new REDCap-based was using pathology reports and available biomarker data confirmed cases after review by epidemiologist,...

NLP is currently dominated by general-purpose pretrained language models like RoBERTa, which achieve strong performance on NLU tasks through pretraining billions of words. But what exact knowledge or skills do Transformer LMs learn from large-scale that they cannot less data? We adopt four probing methods---classifier probing, information-theoretic unsupervised relative acceptability judgment, and fine-tuning tasks---and draw learning curves track the growth these different measures...

The World Trade Center Environmental Health (WTC EHC), is a federally designated clinical center of excellence for surveillance and treatment WTC disaster exposed community members Survivors). Cognitive impairment (CI) has been extensively described in responders concern progressive all groups raised. status, however, not systematically characterized the Survivor population. We describe cognitive status subgroup population referred mental health evaluation (N = 480) EHC as measured by scores...

Abstract Depression is a major contributor to the global burden of disease. There limited understanding how environmental exposures may contribute depression etiology. We used Wave IV National Longitudinal Study Adolescent Adult Health (Add Health) examine associations between low-level ambient air pollution exposure and depressed mood in generally healthy population over 10,000 24–32 year olds. Annual mean PM2.5 levels 2008–2009 study were close current U.S. standard. In fully adjusted...

Background: Sarcoidosis is a granulomatous disease involving intrathoracic and extrathoracic organs. Genetic environmental factors, such as exposure to World-Trade Center (WTC) dust after 9/11, may play role in clinical presentation. Characterization of sarcoidosis community members with the WTC can provide further insight into relationship between sarcoidosis. Methods: Patients documented were identified Environmental Health (EHC), treatment program for members. Demographic data collected...

(1) Background: Variants of the interleukin-1 receptor antagonist (IL1RN) gene, encoding an anti-inflammatory cytokine, are associated with asthma. Asthma is a chronic inflammatory disease airway influenced by interactions between genetic variants and environmental factors. We discovered gene–environment interaction (GEI) IL1RN polymorphisms childhood tobacco smoke (ETS) exposure on asthma susceptibility in urban adult population. (2) Methods: DNA samples from NYU/Bellevue Registry were...

Phelan-McDermid Syndrome (PMS) is a rare genetic disorder caused by deletion or sequence variation in the SHANK3 gene at terminal chromosome 22 that confers high likelihood of comorbid autism spectrum (ASD). Whereas individuals with idiopathic ASD (iASD) can demonstrate diverse patterns sensory differences, PMS mainly characterized hyporesponsiveness. This study used electrophysiology and passive auditory habituation paradigm to test for neural markers EEG was recorded from 15 PMS, iASD, 16...

Exposure to World Trade Center (WTC) dust/fumes and traumas on 11 September 2001 has been reported as a risk factor for post-traumatic stress disorder (PTSD) other mental/physical health symptoms in WTC-affected populations. Increased systemic inflammation oxidative from the exposure subsequent illnesses have proposed contributors underlying biological processes. Many blood-based biomarkers of inflammation, including C-reactive protein (CRP), are useful non-invasive diagnostic monitoring...

The destruction of the World Trade Center (WTC) towers on 11 September 2001 resulted in acute and chronic dust fume exposures to community members, including local workers residents, with well-described aerodigestive adverse health effects. This study aimed characterize lung cancer WTC Environmental Health (WTC EHC) focusing gender smoking history. EHC patients undergo an initial evaluation that includes exposure information, demographics, tobacco use. Detailed characteristics are recorded...

Background: The characteristics of community members exposed to World Trade Center (WTC) dust and fumes with Chronic Obstructive Pulmonary Disease (COPD) can provide insight into mechanisms airflow obstruction in response an environmental insult, potential implications for interventions. Methods: We performed a baseline assessment respiratory symptoms, spirometry, small airway lung function measures using impulse oscillometry (IOS), blood biomarkers. COPD was defined by the 2019 GOLD...

The destruction of the World Trade Center (WTC) on September 11, 2001 (9/11) released large amounts toxic dusts and fumes into air that exposed many community members who lived and/or worked in local area. Many members, defined as WTC survivors by federal government, developed lower respiratory symptoms (LRS). We previously reported persistence these patients with normal spirometry despite treatment inhaled corticosteroids long-acting bronchodilators. This report expands upon our study this...

The destruction of the World Trade Center towers on 11 September 2001 exposed local residents, workers, and individuals in area (Survivors) to dust fumes that included known suspected carcinogens. Given potential for inhalation toxic substances long latency after exposure, incidence lung cancer is expected increase WTC-exposed individuals. We describe characteristics women WTC Survivors with adenocarcinoma who were enrolled Environmental Health (WTC EHC) between May 2002 July 2021. A total...

Haptic interfaces have untapped the sense of touch to assist multimodal music learning. We recently seen various improvements interface design on tactile feedback and force guidance aiming make instrument learning more effective. However, most are still quite static; they cannot yet progress adjust tutoring strategy accordingly. To solve this problem, we contribute an adaptive haptic based latest flute. first adopted a clutch mechanism enable turn off control flexibly in real time. The...