(Internal) Application Review: Custom QA Filter FAQ

Audience

Internal

Displayed Description

Page Type

Article

Product	Application Review
Expert(s)	Cynthia Day, Shawn Zhang, Sandi Rail (CRM team)
Slack channel
This article was last verified on	04/25/2024

🔍 Articles in This Section

Please use the following list to see additional internal articles regarding Application Review:

(Internal) Application Review Overview
(Internal) Application Review: Branded no-reply
(Internal) Application Review: Custom QA Filter FAQ (📍you are here)

Emergency panic shutoff button?

applicant_review_qa_filter feature flag

Greenhouse:

How are the filter options for questions and answers generated?

We look at the value in the GreenhouseJobPost table, under the questions column. Currently, we allow filtering only of boolean, single_select, and multi_select questions, with open response/freeform text as a potential option if heavily requested by customers.

Why isn’t the filter showing up?

If the job posting has no application questions, or only freeform application questions (which we don’t support filtering for), then the custom Q&A filter won’t show up.

There is a mismatch between the questions I can see on the application profile and the ones in the filter modal. What’s going on?

There are many possibilities here -

 1. The question might not be one of our allowed types of questions. We hide those from the filter modal.
 2. The Job might have changed the questions asked as part of the application process. Older applications will have answers to the questions asked at the time the application was submitted, while GreenhouseJobPost will have been updated with the newest and latest questions and answers.
 3. The applicant might not have given a response to certain questions.
 4. The question is marked as private (confidential) and should not be shown (and correspondingly, is not allowed to be filtered on either).
    1. You can check if this is the case by looking up GreenhouseJobPost and checking if the question is marked private
    2. If the customer would like to see these questions, we can set the feature flag override app_review_show_private_custom_qa

For Eng debugging purposes - our questions/answers in the modal are from GreenhouseJobPost.questions, while the ones displayed in the application while viewing are from GreenhouseApplication.answers. These are your backend source of truth for what values should be.

There is a mismatch between how many applications are loaded in the sidebar and how many the Custom Questions filter button says up top.

The count up top and the loaded applications are separate queries. For some reason, the count query runs considerably slower, and the number in the filter may be slow to update, while the applications query has already populated the sidebar with the appropriate filtered applications. We will improve this

Workday:

Why isn’t the filter showing up?

If the job posting has no application questions, or all non-multiple-choice application questions (which we don’t support filtering for), then the custom Q&A filter won’t show up.

How are the filter options for questions and answers generated?

We look at the total set of all questions in WorkdayQuestion, WorkdayQAAssoc, and WorkdayAnswerOption. Currently, we allow filtering only of MULTIPLE_CHOICE type questions from Workday, which corresponds to single/multi-select from Greenhouse.

For Eng debugging purposes - those 3 above tables are your source of truth for Workday QA data.

Some options are missing in the filter for some questions in comparison to the options in the ATS.

We generate the options based on the set of question/answer options we have in Gem. If there is no application that has a response with a certain option, then it will not appear as a filter option. This is most likely going to occur with questions that have a high probability of being a certain answer (eg, for a US based company hiring in the US, “are you legally allowed to work in the US” or some question of that nature).

Greenhouse:
Workday: