e-News Vol 1 # 5, 2004

 


   
 


IN THIS ISSUE:

Seven Survey Design Mistakes to Avoid
Avoid these deadly design mistakes, and your respondents will thank you or, at least, complete your survey. more

Track Respondents Without Password Security

SurveyWriter's new RID number allows you to track respondents without setting up any password-based security. more

Use the Sort Formula Question to Branch in Randomized Answer Options
As promised in the last issue, this article includes an example how to use the Sort Formula Question to branch in randomized answer options.
more

Support Shorts 
Respondent Classifications Expanded
"Sounds like" Prequestion Filter now available
SurveyWriter.net Enhancement List Online
Enhancement form now available more

   



Seven Survey Design Mistakes to Avoid *

The principles outlined below contain a general guide to help you when you are designing your surveys. These seven rules should help you to improve response rates and ensure the quality of the data collected.

  1. Failing to Start the Survey With an Introduction

  2. Using the Wrong Question Type

  3. Making the Questions/Survey Too Long

  4. Using Nonstandard Question Layout 

  5. Making the Survey Too Complex

  6. Requiring Answers to all Questions 

  7. Setting Up Large, Multi-Question Pages

Failing to Start the Survey With an Introduction

Don't underestimate the importance of the introduction. The introduction should both ease the respondent into the survey and motivate the person to complete the survey. It should also instruct the respondent on how to get to the first question in the survey. For example, you could create an introductory page that contains a motivational message, reminds respondents of any incentive, and prompts respondents to enter the password they received through email. Give respondents confidence that they can complete the survey without any trouble.

Using the Wrong Question Type

Many times problems can be avoided by using the right tool for the job. For example, do not use alpha text boxes if you are trying to create a ranking or percentage allocation question. Often, one row question is better than merging a lot of similar questions onto the same page.

Question Types

When to use them
Single Choice Radio Buttons

Use for questions requiring a single response such as a rating scale question. 

Multiple Selection Check Boxes

Use for questions that can have multiple responses (check box format)

Open-End Text

Use for open-end responses (scrolling text box format), such as a short phrase like a name or address or longer explanation response.

Multiple Selection Scrolling List

Use for questions that can have multiple responses (dropdown list format) 

Single Choice Drop-down list

Use for questions requiring a single response such as a rating scale question. 

Numeric Text Box

Use for questions that require a numeric response.         

Alpha Text Box

Select this option create a question that requires a text answer, such as a Contact Information page.

Drop-Down List 

Use to create a dropdown list that appears in every cell. This option creates a three dimensional grid (X by Y by Z).

Row Question 

Use this option to create a grid that allows for a series of rating scales. The statements or attributes make up the rows and the rating points make up the columns. Each row is treated as a separate question.  

Column Questions

Use this option create a grid that displays a series of questions that allows for multiple responses. The options make up the rows, and the questions make up the columns. Each column is treated as a separate question.

Ranking Text Boxes

Use to create a series of text boxes to rank a series of objects. In any individual column, no number can be repeated. 

Percentage Allocation Boxes

Select this option to create a question that requires respondents to have the items in the column total 100%. Use this option to ask a question that involves percentage expenditures or time.  

Formula Questions

Usually, a formula question is inserted after a parent question to convert some information from that parent question into new answer codes and labels that can be used in subsequent questions. Many formula questions are available including constants, random values, Boolean values, point values, single values, and multivalues. Use the formula questions to build new questions on-the-fly using equations and calculations.

Making the Questions/Survey Too Long

Brevity remains "the soul of wit." Shorter surveys promote higher response rates. To promote clarity and understanding, try to keep questions under 25 words.

Respondents read more accurately and tend not to jump over words when lines are kept short. SurveyWriter wraps the text of questions, question headers, and project headers. However, if you feel that your question text still extends too far across the respondent’s screen, you can increase readability by inserting hard-carriage returns in the text as needed.

While SurveyWriter can easily handle it, making a survey over 200 questions long will certainly test your respondent's ability to handle it.

Using Nonstandard Question Layout 

You are safe if you copy standard paper questionnaire layouts. Make sure that the respondent knows where to start reading each screen. Respondents expect to see question content displayed in the upper left-hand corner of the screen. Use bold or larger fonts and spacing to clearly identify the beginning of individual questions. Two good fonts to use include Arial and Verdana, which are simple and easy to read. Also, avoid overusing color. Limit color to one primary and one or two secondary colors unless you are trained in design. 

Making the Survey Too Complex

If you can avoid it, limit the use of animation, sound, and embedded programs. Some respondents don’t have the necessary set up, including computer hardware, latest-and-greatest browser, and communication lines, to receive or respond to surveys with complex programming features. Complicated skip patterns are a great feature of online surveys, but be aware of the memory demands that such a survey will place on a respondent’s system.

Requiring Answers to all Questions 

Requiring answers to all questions tends to frustrate some respondents, offends their sense of "ownership" over the process, and ultimately increases terminate rates. Use SurveyWriter's “Required Question” feature selectively. One possible solution is to provide answers such as “prefer not to answer” or “don’t know” for required questions.

Setting Up Large, Multi-Question Pages 

By placing many questions onto a single page, you limit your ability to incorporate skip patterns and piped responses.
________________

References
Don A. Dillman, Robert D. Tortora, and Dennis Bowker. 1998 Principles for Constructing Web Surveys

Track Respondents Without Password Security

If you send out your own email survey invitations, SurveyWriter provides a new RID number function that enables you to track which respondents have completed the survey and which require a reminder email, without the need to set up password-based security. Of course, this function is only intended if you want to track respondents, but you don't need any security features. 

To track respondents, add a unique respondent tracking ID to each URL. The ID can consist of any combination of characters up to 50 characters.
  The format of the URL is as follows: 
http://www.surveywriter.com/in/survey/survey999/Trackstudy.asp?RID=123456

http://www.surveywriter.com/in/survey/survey999/Trackstudy.asp? = survey link
RID = Indicates that this is a respondent ID.
123456 =  Respondent number.

When a respondent completes a survey, this ID is placed in the data file in the Password field. You can download data to retrieve this information. 

Two other variable names can also be substituted for the RID number to accommodate specific panel providers:

GID for Greenfield
PID for SurveySampling

Both variable names work similarly to the RID number described above.


Use the Sort Formula Question to Branch in Randomized Answer Options

A Sort List formula question enables you to take answers from other questions and put them into a new list. This list is then sorted in either ascending or descending order according to your preference. This formula question also allows you to select the top n answers (e.g., top 3 answers numerically) bottom n answers (e.g., bottom 3 answers numerically), the rank order number (e.g., answer ranked third numerically), or random numbers (e.g., 3 random answers). This example uses the Sort question to display 3 random answers to the respondent in a follow-up branching question.

Create Sort Formula Question

  1. Click Insert Answer.
  2. Enter 1 as the first answer and enter 1 for the value to generate for this first answer.
  3. Repeat step 2 for all desired response options. In this example, seven response options are defined and seven values, 1 through 7, are entered for these options. Because we are not pulling from other questions, just introducing new answer options, we've used 1 through 7 as our answers.

  1. For Select Rank, choose Random 3.
  2. Save the Sort Question option screen.
  3. Click Set Answer Options> Build Answer Options from the Question screen.
  4. Enter the options that you want to display randomly in your follow-up branching question.

  1. Save the question.

Create Follow-Up Branching Question

The example below is an open end question that branches in three random answers options from the Sort formula question. 

  1. Click Select A Question Type>Standard Question>Open End Text from the Question menu.
  2. On the Question Options screen, click Branch Question.

  1. Select the formula question you created as your branch parent.
  2. Enter 3 as the number branch questions to ask.
  3. Click Last Branch Question to indicate that this last branch question to be asked in this series.
  4. Save the Question Options screen.
  5. Click Question Page Text>Question Text to enter your question. Make sure to put the branch identifier symbol, |, at the spot at which you want the options from your formula question to appear. 
For example: What do you like about |?
  1. Save the question.

Support Shorts 

Respondent Classifications Expanded  

SurveyWriter has expanded its classifications for respondents to include two new designations. Previously, you could only download data for "completes" and "terminates."  Now, classifications for "over quota" and "incompletes" have been added to the Data Download program. Each classification is described below.

Completes:  Any respondent who completes the survey and gets to the "Closing Page." 
Terminates: Any respondent who meets a condition defined in a Quota Control set to a limit of zero.
Over Quota: Any respondent who meets a condition defined in a Quota Control set to a limit of more than zero.
Incompletes: Any respondents who do not meet any of the above criteria, including respondents who quit or temporarily suspended the survey voluntarily, were disconnected because of an Internet connection issue, were jettisoned from the survey because of a programming problem, or are currently taking the survey. 

"Sounds like" Prequestion Filter now available

The new SOUNDX filter is designed for awareness studies that require respondents to enter the desired responses themselves. If a respondent enters something close to the intended word, the respondent will be allowed to see the next question. For example, you may want to show a question only to those who entered the words, "Federal Express" in the previous question. However, you don't want to exclude them if they've spelled their response slightly incorrectly such as:

Fedral Express
Fed Ex
Fedral Expres
etc.

The SOUNDX filter is used to ensure that all spellings close to the correct one will be accepted. Use the following syntax in prequestion filters.

{Q1-C1-R1 [SOUNDX2] Federal Express}

Q1-C1-R1 = Question ID with column and row number
SOUNDX = Comparison Operator 
2 =  Level of similarity. Values include 0 through 4: 0 indicates little or no similarity, and 4 indicates strong similarity or identical values
Federal Express = Words to compare to

You will have to experiment with the similarity levels to ensure that you get the desired result from this filter. To help you test your filters, we've included a link to the test program online:

http://www.surveywriter.net/in/DM_Soundx.asp

Enter your desired word in the first space and your comparison word in the second. Press Submit to determine level of similarity. You will need to set your similarity levels in the filter to the number displayed to have that filter work as desired in your survey.

SurveyWriter.net Enhancement List Online

SurveyWriter's programmers have been busy adding features to an already robust feature set. While it's too long to include in this newsletter format, the complete list of new features you can find in SurveyWriter is available at the following link:

SurveyWriter Enhancement List

Enhancement Form Available

SurveyWriter continues to improve its our web survey application based on input and requests from users and trends we see in the industry. A new Enhancement Form is available to make the process of collecting these requests more streamlined.

Click Enhancement Form to enter your requests. 

You are receiving this newsletter because you either are a client of SurveyWriter or registered at the SurveyWriter.com, Web site.

Thank you for your continued support of SurveyWriter. If you have any topics that you would like see addressed in future editions, please email me.

Sincerely,


Vice President, Business Development
773-281-8490 / prv@surveywriter.com





             
 

SurveyWriter is an application service provider to the Market Research Industry specializing in web-based surveys and online market research. If you received this email in error, click here to have your name removed from our list.

Mail requests: 
3717 N Ravenswood Ave, Unit 236
Chicago, IL 60613