Access

How do I login through Online Services?

Students, Faculty, and certain Departmental and College staff are able to access eSET by logging into OSU Online Services and selecting the appropriate menu options. You can access SET from the main Online Services menu by selecting the "Faculty & Advisors" tab. Click on "Instructor Access To Student Evaluation". At this point, another window will pop up and you will be in the SET system.

Be sure to enable pop-up windows in your browser.

Can I directly access eSET?

eSET can also be accessed directly by going to OSU Online Services and logging in using either your ONID username and password or your OSU ID and GAP.

How do departments/administrators for departments get access to eSET?

If a department head, Director, or Dean would like eSET access themselves or access for an administrative assistant, then the Department Head/Dean needs to send a request to the Office of Academic Programs, Assessment, and Accreditation (Cheryl Hagey and Tam Belknap) providing the following:

  • Relevant names
  • Position titles,
  • OSU ID numbers

In order to preserve confidentiality, the Office of Academic Programs, Assessment, and Accreditation requests that access to eSET be selective and limited to non-student, permanent employees who normally have access to sensitive information. We prefer to keep the access list as small as possible.

If someone has been given access to eSET Reports leaves the department or that role, please inform Cheryl Hagey and Tam Belknap, so permissions can be removed

Who has access to what on eSET?

Instructors have access to their own quantitative and qualitative results.

Department Chairs/Program Directors and/or their designee (such as an approved administrative assistant) have access to quantitative summaries of the data for the programs/faculty they supervise. They do not see comments or responses to open-ended questions, unless a student “signs” his or her comments, at which point the students are no longer anonymous.We stress that everyone follow confidentiality protocols, per the Faculty Senate regulations.

Adding Questions

A previous term pops up when I login and I'm not sure how to get to current term to enter new questions.

When you log on and open the page, your course for earlier terms will automatically appear.

In the top blue bar click on the orange text "My Evaluation Questions." It will take you to a page where you can create questions. Make sure you are editing within the current term, which is located at the very top under “term.”

Can I add questions after the deadline?

No, new questions cannot be added after the deadline has closed (refer to the calendar to view deadlines for the current term). You may, however, consider doing a supplemental handout in class if you really would like students' feedback on those specific items.

How do I add questions for crosslisted courses (e.g. ME 499/599)? Do we only enter the questions once for the course, or do we enter the questions for each CRN?

You need to enter the questions for each CRN separately.

What if I receive an error message like "There was an error retrieving data from the server. You may be logged out of the system"?

That error may show up if your questions have more than 500 characters, or if they have an abbreviation of more than 100 characters. Try editing your questions and see if that resolves the problem. In addition, each question must be entered separately.

How do I view preexisting questions? (I need to see those to decide what new questions I should ask)

A list of preexisting questions can be found in our Standard University Questions page.

If you taught in the Fall 2011 term and entered your own unique questions into the system, unfortunately you will not be able to see those and they will need to be re-entered into the system. One way to view your unique questions would be to go back and look at your evaluation report from last term.

Blank Page

I keep getting a blank page when I go into eSET.

This commonly happens because of browser issues. For example pop-ups need to be enabled or allowed on your browser. Sometimes if a blank page comes up, you need to clear the cache in your browser. Or you may need to try a new browser (Firefox seems to work well. Google Chrome and Explorer seem to have more problems). Visit our Resolving Technical Problems page for information on this and other technical issues.

Courses in eSET

Are there any courses not included in eSET?

All OSU credit classes are included in eSET except for INTO IEP courses, 700 level Pharmacy courses, and certain Veterinary Medicine courses. Most blanket courses (with the exception of Honors courses) are also excluded, such as those whose numbers start with 401-410, 501-510, 601-610, 701-710, and 801-810. Also, courses with fewer than 6 students are excluded from the eSET.

What if there are fewer than 6 students in my course?

Evaluations will NOT be collected for courses with fewer than 6 students.  This is to protect the students anonymity.

If you have cross listed/slash courses with fewer than 6 students, those evaluations will be collected and combined with the other cross listings for the course.

Per Faculty Senate.

Evaluation Results

When can instructors see evaluation results?

Please visit the calendar for the current term to find out when evaluation results are available to the instructors.

How does a department obtain reports?

  1. Go to OSU website’s Online Services
  2. Click OS and enter ONID User name and password
  3. Click Faculty/Adviser
  4. Go to Instructor Access to Student Evaluation

You can obtain departmental summary reports by selecting “Summary Reports” or individual course reports by selecting the “Report Browser” link.

If you have technical issues then visit our Resolving Technical Problems page.

How can I obtain reports for the teaching assistants that I supervise?

The person with access rights (the departmental administrative person with permissions) will need to go in and compile a report for the instructor. They can do this by going into eSET and selecting the relevant courses and sections and exporting as an Excel file or as PDFs. These can then be sent to the instructor. Per University policy, the instructor will not see the comments (unless the comment is signed) or responses to open-ended questions.

I am concerned students will see their grade and it will influence their evaluation of my class.

This is natural concern since we want students to evaluate the course and our instruction in the course fairly and with the whole course in mind - not just a "single grade." Although it is possible that a student might rate a course based upon a grade, the majority of the research shows that student grades rarely/barely/if at all affect faculty evaluations. There have been nearly 500 research studies investigating this question. In his book "Developing a Comprehensive Evaluation System" (Arreola, 2007, pg. 101), Arreola summarizes the results from the bulk of these studies and states:

"The answer is there is no consistent correlation between the grades a faculty member gives and the ratings he or she receives from a well-designed student rating form...the bulk of the correlations appearing in the literature have been quite weak ranging from -0.18 to +0.18 (i.e., average r=0.0)."

Grades

How do I hide grades from students in Canvas?

If you are using Canvas and you do not want the students to see their grade total prior to the evaluation, then you will need to hide the grade totals within your Canvas course.  Hiding grades in Canvas is purely optional. To hide grade totals in Canvas, click on Settings in your Canvas course and scroll to the bottom of the Course Details tab. Click on More Options, check the box next to “Hide totals in student grades summary”, and click Update Course Details. If you have questions about this feature in Canvas, or if you have other Canvas questions, please email Canvas@oregonstate.edu

I am concerned students will see their course grade prior to completing their evaluations.

 If you are using the Canvas grade book and you do not want students to see their grade totals, you can hide grade totals in your Canvas course (see FAQ above). 

Can grades be seen during evaluation period?

Student evaluations (eSETs) will not be open during finals week due to graduation pre-clearance. Final grades posted prior to the close of the student evaluation period (see dates in official email each term) may be visible to students.

Multiple Instructors

How do evaluations occur in courses with multiple (two or more) instructors?

If there are multiple instructors for the course, then each instructor will be evaluated by the students only if each instructor is listed in the banner system with 2% or more responsibility. Otherwise, if a course with multiple instructors is set up only under one faculty person’s name, then students will see that faculty member’s name only as the one being evaluated.

It is important to correctly set up courses with multiple instructors, be they in the same or different sections.

Median Calculation

How is the median calculated?

The median is the value on the score scale that separates the top half of the group from the bottom half. OSU uses a calculation that assumes that multiple values within a range are distributed evenly over the range.

A calculation of this type results in a more complete set of values. (The traditional computation of median might result in values of 5.0, 5.5, 6.0. The OSU calculation results in values 5.0, 5.1, 5.2, and so on to 6.0). This calculation has been used for OSU student evaluations since 2004.

There is a good detailed explanation with examples on page 33 of "Measurement and Evaluation in Psychology and Education", Fourth Edition, by Robert L. Thorndike and Elizabeth P. Hagen.

Reminders

Do I need to send out a reminder to students for eSET completion?

Automated emails are sent to all currently enrolled OSU students announcing when eSET is available for completion (refer to the calendar for specific dates). The email provides instructions, a timeline for completion, and contact information should they encounter difficulties with, or have questions regarding, their evaluations. Additional reminders are provided to remind students to complete their evaluations.

Reporting

Can you pull reports on just the additional questions?

No. All questions are downloaded together (administrators will not receive open-ended/qualitative questions or comments). If you export the report as an Excel spreadsheet you could more easily sort out questions.