|

Seven Survey
Design Mistakes to Avoid *
The principles outlined below contain a general
guide to help you when you are designing your surveys. These seven rules should
help you to improve response rates and ensure the quality of the data collected.
-
Failing to Start the Survey With an Introduction
-
Using the Wrong Question Type
-
Making the Questions/Survey Too Long
-
Using Nonstandard Question Layout
-
Making the Survey Too Complex
-
Requiring Answers to all Questions
-
Setting Up Large, Multi-Question Pages
Failing to Start the
Survey With an Introduction
Don't underestimate the importance of the
introduction. The introduction should both
ease the respondent into the survey and motivate the person to complete the
survey. It should also instruct the respondent on how to get to the first
question in the survey. For example, you could create an introductory page that
contains a motivational message, reminds respondents of any incentive, and prompts
respondents to enter the password they received through email. Give respondents
confidence that they can complete the survey without any trouble.
Using the Wrong
Question Type
Many times problems can be avoided by using the
right tool for the job. For example, do not use alpha text boxes if you are
trying to create a ranking or percentage allocation question. Often, one row
question is better than merging a lot of similar questions onto the same page.
|
Question
Types
|
When
to use them
|
| Single
Choice Radio Buttons
|
Use
for questions requiring a single response such as a rating scale question.
|
|
Multiple
Selection Check Boxes
|
Use
for questions that can have multiple responses (check box format)
|
|
Open-End
Text
|
Use
for open-end responses (scrolling text box format),
such as a short phrase like a name
or address or longer explanation response.
|
|
Multiple
Selection Scrolling List
|
Use
for questions that can have multiple responses (dropdown list format)
|
|
Single
Choice Drop-down list
|
Use
for questions requiring a single response such as a rating scale question.
|
|
Numeric
Text Box
|
Use
for questions that require a numeric
response.
|
|
Alpha
Text Box
|
Select
this option create a question that requires a
text answer, such as a Contact Information page.
|
|
Drop-Down
List
|
Use
to create a dropdown list that appears in every
cell. This option creates a three dimensional grid (X by Y by Z).
|
|
Row
Question
|
Use
this option to create a grid that allows for a series of rating scales.
The statements or attributes make up the rows and the
rating points make up the columns. Each row is treated as a separate
question.
|
|
Column
Questions
|
Use
this option create a grid that displays a series of questions that allows
for multiple responses. The options make up the rows, and the questions
make up the columns. Each column is treated as a separate question.
|
|
Ranking
Text Boxes
|
Use
to create a series of text boxes to rank a series of objects. In any
individual column, no number can be repeated.
|
|
Percentage
Allocation Boxes
|
Select
this option to create a question that requires respondents to have the
items in the column total 100%. Use this option to ask a question that
involves percentage expenditures or time.
|
| Formula
Questions
|
Usually,
a formula question is inserted after a parent question to convert some
information from that parent question into new answer codes and labels
that can be used in subsequent questions. Many formula questions are
available including constants, random values, Boolean values, point
values, single values, and multivalues. Use the formula questions to build
new questions on-the-fly using equations and calculations.
|
Making the
Questions/Survey Too Long
Brevity
remains "the soul of wit." Shorter surveys promote higher response
rates.
To promote clarity and
understanding, try to keep questions under 25 words.
Respondents
read more accurately and tend not to jump over words when lines are kept short. SurveyWriter wraps the text of questions,
question headers, and project headers. However, if you feel that your question
text still extends too far across the respondent’s screen, you can increase
readability by inserting hard-carriage returns in the text as needed.
While
SurveyWriter can easily handle it, making a survey over 200 questions long will
certainly test your respondent's ability to handle it.
Using
Nonstandard Question Layout
You are safe if you copy
standard paper questionnaire layouts. Make sure that the respondent knows where
to start reading each screen. Respondents expect to see question content
displayed in the upper left-hand corner of the screen. Use bold or larger fonts
and spacing to clearly identify the beginning of individual questions. Two good
fonts to use include Arial and Verdana, which are simple and easy to read. Also,
avoid overusing color. Limit color to one primary and one or two secondary colors unless
you are trained in design.
Making the
Survey Too Complex
If you can avoid it, limit the use of animation,
sound, and embedded programs. Some respondents don’t have the necessary set
up, including computer hardware, latest-and-greatest browser, and communication
lines, to receive or respond to surveys with complex programming features.
Complicated skip patterns are a great feature of online surveys, but be aware of
the memory demands that such a survey will place on a respondent’s system.
Requiring
Answers to all Questions
Requiring answers to all
questions tends to frustrate some respondents, offends their sense of
"ownership" over the process, and ultimately increases terminate
rates. Use SurveyWriter's “Required Question” feature selectively. One
possible solution is to provide answers such as “prefer not to answer” or
“don’t know” for required questions.
Setting
Up Large, Multi-Question Pages
By placing many questions onto a single page, you
limit your ability to incorporate skip patterns and piped responses.
________________
* References
Don A. Dillman, Robert D.
Tortora, and Dennis Bowker. 1998 Principles for Constructing Web Surveys

Track Respondents Without Password Security
If you send out your own email survey
invitations, SurveyWriter provides a new RID number function that enables you to
track which respondents have completed the survey and which require a reminder
email, without the need to set up password-based security. Of course, this
function is only intended if you want to track respondents, but you don't need
any security features.
To track respondents, add a unique respondent tracking ID to each URL. The ID
can consist of any combination of characters up to 50 characters.
The format of the URL is as follows:
http://www.surveywriter.com/in/survey/survey999/Trackstudy.asp?RID=123456
http://www.surveywriter.com/in/survey/survey999/Trackstudy.asp?
= survey link
RID = Indicates that this is a respondent ID.
123456 = Respondent number.
When a respondent completes a survey, this ID is placed in the data file in the
Password field. You can download data to retrieve this
information.
Two other variable names can also be substituted
for the RID number to accommodate specific panel providers:
GID for Greenfield
PID for SurveySampling
Both variable names work similarly to the RID
number described above.


Use
the Sort Formula Question to Branch in Randomized Answer Options
A Sort List formula question enables you to take
answers from other questions and put them into a new list. This list is then
sorted in either ascending or descending order according to your preference.
This formula question also allows you to select the top n answers (e.g.,
top 3 answers numerically) bottom n answers (e.g., bottom 3 answers
numerically), the rank order number (e.g., answer ranked third numerically), or
random numbers (e.g., 3 random answers). This example uses the Sort question to
display 3 random answers to the respondent in a follow-up branching question.
Create Sort Formula Question
- Click Insert Answer.
- Enter 1 as the first answer and enter 1 for
the value to generate for this first answer.
- Repeat step 2 for all desired response
options. In this example, seven response options are defined and seven
values, 1 through 7, are entered for these options. Because we are not
pulling from other questions, just introducing new answer options, we've
used 1 through 7 as our answers.

- For Select Rank, choose Random 3.
- Save the Sort Question option
screen.
- Click Set Answer Options> Build
Answer Options from the Question screen.
- Enter the options that you want to display
randomly in your follow-up branching question.

- Save
the question.
Create Follow-Up Branching Question
The example below is an open
end question that branches in three random answers options from the Sort formula
question.
- Click Select A Question Type>Standard
Question>Open End Text from the Question menu.
- On the Question Options screen, click Branch
Question.

- Select the formula question you created as
your branch parent.
- Enter 3 as the number branch
questions to ask.
- Click Last Branch Question to
indicate that this last branch question to be asked in this series.
- Save the Question Options screen.
- Click Question Page Text>Question
Text to enter your question. Make sure to put the branch identifier
symbol, |, at the spot at which you want the options from your formula
question to appear.
For example:
What do you like about |?
- Save the question.


Support
Shorts
Respondent Classifications Expanded
SurveyWriter has expanded its
classifications for respondents to include two new designations. Previously, you
could only download data for "completes" and
"terminates." Now, classifications for "over quota"
and "incompletes" have been added to the Data Download program. Each
classification is described below.
Completes: Any respondent who
completes the survey and gets to the "Closing Page."
Terminates: Any respondent who meets a condition defined in a Quota Control
set to a limit of zero.
Over Quota: Any respondent who meets a condition defined in a Quota Control
set to a limit of more than zero.
Incompletes: Any respondents who do not meet any of the above criteria,
including respondents who quit or temporarily suspended the survey voluntarily,
were disconnected because of an Internet connection issue, were jettisoned from the survey because of a programming problem,
or are currently taking the survey.
"Sounds like" Prequestion Filter now available
The new SOUNDX filter is designed for awareness
studies that require respondents to enter the desired responses themselves. If a respondent
enters something close to the intended word, the respondent will be allowed to
see the next question. For example, you may want to show a question only to
those who entered the words, "Federal Express" in the previous
question. However, you don't want to exclude them if they've spelled their
response slightly incorrectly such as:
Fedral Express
Fed Ex
Fedral Expres
etc.
The SOUNDX filter is used to ensure that all spellings
close to the correct one will be accepted. Use the following syntax in
prequestion filters.
{Q1-C1-R1 [SOUNDX2] Federal Express}
Q1-C1-R1 = Question ID with column and row number
SOUNDX = Comparison Operator
2 = Level of similarity. Values include 0 through 4: 0 indicates
little or no similarity, and 4 indicates strong similarity or identical values
Federal Express = Words to compare to
You will have to experiment with the similarity
levels to ensure that you get the desired result from this filter. To help you
test your filters, we've included a link to the test program online:
http://www.surveywriter.net/in/DM_Soundx.asp
Enter your desired word in the first space and
your comparison word in the second. Press Submit to determine
level of similarity. You will need to set your similarity levels in the filter
to the number displayed to have that filter work as desired in your survey.
SurveyWriter.net Enhancement List Online
SurveyWriter's programmers have been busy adding features to an already
robust feature set. While it's too long to include in this newsletter format,
the complete list of new features you can find in SurveyWriter is available at
the following link:
SurveyWriter
Enhancement List
Enhancement Form Available
SurveyWriter continues to improve its our web survey application based on input
and requests from users and trends we see in the industry. A new Enhancement
Form is available to make the process of collecting these requests more
streamlined.
Click Enhancement
Form to enter your requests.

 You
are receiving this newsletter because you either are a client of SurveyWriter or
registered at the SurveyWriter.com, Web site.
Thank you for your continued support of SurveyWriter. If you have any
topics that you would like see addressed in future editions, please email me.
Sincerely,

Vice President, Business Development
773-281-8490 / prv@surveywriter.com
|