Evidence Building

October 2024: Documenting judging experience for O-1

Expert analysis of recent developments and their impact on O-1 petitioners. Key takeaways inside.

Oct 26, 2024 · 8 min read

The judging criterion and what is at stake

The judging criterion is one of the more accessible of the eight O-1A criteria listed under 8 C.F.R. § 214.2(o)(3)(iii), and it is one of the most commonly asserted in petitions across a wide range of fields. At its core, the criterion requires that the petitioner have participated as a judge of the work of others in the same or an allied field. When properly documented, judging experience can satisfy this criterion as a standalone claim that, combined with two other well-supported criteria, completes the three-criterion minimum for O-1A eligibility. When improperly documented — or when the judging activity does not actually meet the regulatory standard — the criterion generates RFEs and denials that a careful evidence-gathering strategy would have prevented.

USCIS adjudicators are instructed under the USCIS Policy Manual to evaluate judging criterion claims under the totality of the evidence standard. A single panel participation at a minor internal event carries less weight than a sustained record of peer review for recognized journals, grant application evaluation for federal agencies, or competition judging for recognized industry awards. The regulatory text does not specify how many judging events are required, but adjudicative practice has established that a single judging instance is typically insufficient without other evidence of recognition that, together with the judging evidence, establishes the petitioner as someone whose expertise has been sought repeatedly by recognized institutions.

For petitioners who are assembling evidence in October 2024, the judging criterion often presents an opportunity that is underutilized: many professionals who would qualify to judge recognized competitions, review grant applications, or participate in peer review for recognized journals have not yet done so and are not aware that these activities generate O-1A criterion evidence. Identifying and pursuing these opportunities in the months before petition filing is among the most practical and achievable evidence-building strategies available to petitioners who are strong on some criteria but need to establish the judging criterion.

What the regulation actually requires

The regulatory text under 8 C.F.R. § 214.2(o)(3)(iii)(B) states that evidence of participation as a judge of the work of others in the same or allied field satisfies the judging criterion. The regulation does not require that the petitioner have served as a named judge at a well-known competition. It requires participation — a term that encompasses peer review for scientific journals, grant application review for recognized funding agencies, competition evaluation for industry awards, oral examination participation in academic settings, portfolio review for recognized residency or fellowship programs, and similar activities where the petitioner's expertise is applied to evaluate the work of colleagues or competitors in the same field. The breadth of activities that can satisfy the judging criterion means that most senior professionals in their field have some qualifying activity; the challenge is identification and documentation rather than participation itself.

The field requirement — that the judging be in the same or an allied field — is generally interpreted broadly by adjudicators. A software engineer who reviews papers for an AI safety conference judges work in an allied field even if the specific technical area of the papers differs from the engineer's primary research specialty. A fashion designer who evaluates portfolios for a design school's admissions panel judges work in an allied field even if the applicants' work spans a range of design disciplines. Allied field interpretations are typically noncontroversial unless the judging activity is in a field so remote from the petitioner's specialty that no reasonable connection exists. Practitioners should include a brief explanation in the petition brief of why a particular judging activity is in the same or allied field when the connection is not self-evident.

The quality of the organizations for which the petitioner judged matters to adjudicators, though the regulation does not explicitly require that the judging be for a prestigious organization. Peer review for a recognized journal — one that appears in standard academic databases, has an established editorial process, and is cited in the field's literature — carries more evidential weight than peer review for a publication of uncertain standing. Grant review for a federal agency such as the NSF or NIH, or for a recognized private foundation such as the MacArthur Foundation or the Ford Foundation, carries more weight than evaluation for an unknown funder. When documenting judging activity, the documentation should establish the organization's standing in the field, not merely confirm that the petitioner participated.

Evidence that satisfies the judging criterion

Peer review for recognized scientific journals is among the most straightforward judging criterion evidence for academic and research-oriented petitioners. The petition should document the specific journals for which the petitioner has reviewed, the approximate number of manuscripts reviewed, and the journals' standing in the field — typically established through their impact factors, their indexing in standard databases such as Web of Science or Scopus, and expert letter confirmation of their standing. A letter from a journal editor confirming that the petitioner has served as a reviewer for the journal, combined with documentation of the journal's standing, satisfies the criterion on its own terms and is easy to obtain since most journals maintain reviewer records and are willing to provide confirmation letters for visa purposes.

Grant review panels at federal agencies provide strong judging criterion evidence because the agencies' distinguished reputations are well-established and adjudicators are familiar with them. Review panels for NSF programs, NIH study sections, DOE grant competitions, and NEA grant programs are invitation-only bodies whose members are selected based on demonstrated expertise in the relevant field. Participation in a federal grant review panel is itself evidence of peer recognition as well as judging, making this activity valuable for two criteria simultaneously. Documentation includes the invitation letter from the agency, the petitioner's confirmation of participation, and if available, any acknowledgment of the petitioner's contribution to the panel's work. Panel participation is typically confidential regarding the specific applications reviewed, but the fact of participation can be documented.

Competition judging for recognized industry awards provides strong evidence in fields where awards programs are central to the profession's recognition infrastructure. Architecture competitions administered by the American Institute of Architects, fashion awards organized by the Council of Fashion Designers of America, technology award competitions organized by the Consumer Electronics Association or the IEEE, film festival competitions at recognized film festivals, and design awards organized by AIGA all provide judging opportunities that satisfy the criterion when the petitioner's evaluation role is documented. The documentation should distinguish between a selection panel member — whose evaluative function is primary — and an honorary member or advisory board participant whose role may be ceremonial rather than evaluative.

Evidence USCIS has discounted

USCIS has discounted judging criterion claims where the documentation does not clearly establish that the petitioner had an evaluative function as opposed to an honorary or advisory role. An invitation to a conference as a keynote speaker does not satisfy the judging criterion even if the conference also includes an awards program; the petitioner must have actually evaluated the work of others in a defined selection process. Honorary membership on an award committee without documented participation in the evaluation process has also been discounted. Advisory board membership at a professional association, while potentially supporting the peer recognition criterion, does not satisfy the judging criterion unless the advisory board's specific function includes evaluation of submitted work.

Internal evaluation activities within a single organization — performance review participation, internal technical review boards, internal grant or project selection committees — have generally received less weight than external judging activities, though they are not categorically excluded. The adjudicative concern with internal evaluation is that it is not independently verifiable and does not reflect the same form of peer recognition as an external invitation. When internal judging activities are the only available evidence of judging, the petition should document the process thoroughly — the number of submissions evaluated, the selection criteria applied, the outcome of the evaluation, and the standing of the projects or teams that were evaluated — to establish that the activity reflects a meaningful evaluative function rather than routine workplace participation.

Judging activities documented only by the petitioner's own statement, without corroborating documentation from the organization that conducted the competition or review process, have also been discounted. Self-reported judging activity is not independently verifiable, and USCIS adjudicators apply the preponderance of evidence standard to all criterion claims. The most effective judging criterion evidence is an invitation letter from the organization, a post-participation acknowledgment letter, or a certificate of participation, combined with independent documentation of the organization's standing. When original invitation letters are unavailable — because the activity occurred years before the petition was prepared — practitioners should request confirmation letters from the relevant organization and explain in the brief why contemporaneous documentation is not available.

Borderline cases and how they are argued

The most common borderline scenario for the judging criterion involves peer review for publications of uncertain or unestablished standing. Preprint repositories such as arXiv and bioRxiv do not conduct peer review in the traditional sense, and reviewing manuscripts submitted to preprint servers does not satisfy the judging criterion. Open peer review models at journals that publish all submissions with reviewer commentary rather than using reviewer evaluations to determine publication are similarly limited in their evidential value for the judging criterion. The key question is whether the petitioner's evaluation had the potential to determine whether the work was accepted or rejected — the gatekeeping function of traditional peer review — rather than merely providing commentary on already-accepted work.

Conference paper reviewing at competitive academic venues represents a strong form of judging evidence in fields where conference publication is the primary dissemination channel. AI and computer science conferences — NeurIPS, ICML, ICLR, ACL, EMNLP — have single-digit acceptance rates and rigorous multi-round review processes in which paper reviewers make substantive recommendations that determine acceptance. The petitioner who can document service as a reviewer for these conferences has strong judging criterion evidence, even though the conferences are nominally review rather than competition events, because the reviewers are selected based on expertise and perform a gatekeeping function equivalent to journal peer review. Documentation from the program chairs confirming the petitioner's reviewing role and the conference's acceptance process supports this argument.

Dissertation committee membership presents a nuanced borderline case. Serving as a primary advisor to a doctoral student clearly involves evaluative functions that satisfy the judging criterion — the advisor determines whether the dissertation meets the field's standards and whether the defense is satisfactory. Serving as an external committee member or external examiner is a more limited evaluative function but still involves assessment of the dissertation's quality and recommendation regarding the student's candidacy. Both roles differ from honorary roles on dissertation committees where the member's participation is formal but the evaluation function is exercised by other committee members. Expert letters explaining the petitioner's specific role in the doctoral evaluation process, and the significance of that role in the field's credentialing system, help establish that the activity satisfies the judging criterion rather than resembling the ceremonial advisory roles that USCIS has discounted.

Audit checklist for judging evidence

Before including judging criterion evidence in a petition, practitioners should verify the following: that the petitioner had a genuine evaluative function, not merely an advisory or honorary role; that the organization for which the petitioner judged has an established reputation in the field that can be documented; that the documentation of the judging activity comes from the organization rather than solely from the petitioner's own description; that the field in which the judging occurred is the same as or clearly allied with the petitioner's primary field of extraordinary ability; and that at least one judging instance is supported by documentation sufficient to establish the activity on its own merits, rather than relying on a cumulative argument from multiple underdocumented instances.

For petitioners who lack sufficient judging evidence at the time of the initial eligibility assessment, the action plan for October 2024 should include outreach to appropriate organizations. Journal editors for recognized publications in the petitioner's field can be contacted directly to request inclusion in the reviewer pool; most journals welcome qualified reviewers and can begin assigning manuscripts within weeks of confirming the reviewer's qualifications. Grant agencies that accept volunteer reviewer applications — including some NSF programs and private foundations — publish information about their reviewer recruitment processes. Professional associations in most fields conduct award competitions with panels that can be joined through formal application or nomination.

The judging criterion documentation should be assembled as a standalone exhibit in the petition package, with a cover page identifying the criterion, followed by the documentation of each judging activity in reverse chronological order. Each activity should be supported by the organization's confirmation letter, a one-paragraph description of the petitioner's specific evaluative role, and documentation of the organization's standing where that standing is not universally recognized. The petition brief should address the judging criterion with a summary of the activities documented and an explicit statement that the evidence establishes participation as a judge of the work of others in the same or allied field — the regulatory language from 8 C.F.R. § 214.2(o)(3)(iii)(B) — to give the adjudicator a clear criterion-to-evidence mapping.