Keith Markus' Urban Sprawl


Course Information
Links
Syllabus
 Blackboard Login
Schedule
Site Map
Grading
Lloyd Sealy Library
Contact Information
 John Jay Home Page 

PSY715:  Research Design and Methods

Spring 2024
Section 01, Registration Number 40069
Professor Keith A. Markus

Time:
 Section 01:  Wednesdays 6:00-8:00 PM

Room:
  Section 01: NB 3.80, 524 W59 Street, New York, NY 10019 USA. 

Course Description

"Presents the nature of the research process and guidelines for formulating researchable questions and testable hypotheses. Reviews the methods of operationalizing variables and indicators, and collecting data, including designing experiments and carrying out surveys, and evaluating programs. Explains data analysis strategies leading to a written report.  30 hours.  3 credits."  (from Graduate Bulletin)

Course Objectives
1. Students will learn to describe psychological phenomena from a scientific perspective.
2. Students will learn to critically evaluate and reformulate research questions in psychology.
3. Students will learn to apply and critically evaluate common research designs and data collection methods.

Note:  It is not possible for this course to cover all of the methods that you might need for a thesis.  This course is only intended to provide a foundation for further study.

Diversity and Inclusion
Psychological research is conducted by humans and thus vulnerable to human fallibilities and biases in both the conduct and interpretation of the research. Perhaps the most famous historical example of this is the sad history surrounding homosexuality and the Diagnostic and Statistical Manual (DSM;
https://en.wikipedia.org/wiki/Homosexuality_in_the_DSM). The inclusion of psychological disorders in the DSM was decided by vote of a membership made up of practicing psychiatrists who based their decision on their professional practice and case studies drawn from it. However, this empirical base was subject to selection bias. People who come into contact with psychiatrists are more likely to be experiencing some form of psychological distress, producing a biased sample. Psychiatrists had far less contact with psychologically well-adjusted gay and lesbian people and this clouded their professional judgment in treating homosexuality as a psychological disorder. This was only reversed after considerable activism pointing out the error and advocating for a revision of the DSM. Another common source of bias involves availability sampling in which research participants may be drawn from populations that under-represent the diversity of the general population, but results reflecting largely middle-class young white samples are generalized to others without sufficient positive empirical evidence. Systematic research design can provide valuable tools for reducing biases in psychological research. However, values shape every aspect of psychological research from the choice of research questions to the evaluation of the strength of evidence provided by a study. The responsibility remains with the researcher and the consumer of research findings to make values explicit and critically reflect on them. Likewise, past research findings are always subject to re-interpretation based on developments in theory and social context. It is my hope and intent that this course can play at least a small role in helping students further develop critical reasoning skills related to conducting and consuming psychological research that can in turn help the profession avoid repeating past mistakes and do its best to serve as a force for good.

Required Reading

Jhangiani, R. S., Chiang, I-C., A., Cuttler, C. & Leighton, D. C. (N.D.).  Research Methods in Psychology (4th edition, American Version)
https://kpu.pressbooks.pub/psychmethods4e/

This is a free open-source text book (based on a previously published text book).  I will post a PDF version in the learning management system.  Additional formats are available online at the above URL.  Please make sure you have this version as there are several different versions available on the Internet.

I will sometimes post supplementary reading on the learning management system to complement the assigned text book chapter for that week.

Learning Management System
The learning management system for this course will be Blackboard.  The Spring 2024 term will be the swan song for Blackboard as the learning management system at John Jay College of Criminal Justice.  However, my understanding is that Spring 2024 courses will remain accessible for some period beyond the end of the semester.  For more information about the transition to BrightSpace, see the following web page: https://new.jjay.cuny.edu/academics/online-education/learning-management-system/learning-management-system-transition

Note: Some of you may have become accustomed to relying on the learning management system to alert you to all deadlines and due dates.  This approach is not recommended for this course.  Please keep a copy (digital or paper) of the syllabus close at hand throughout the semester.  The schedule on the syllabus is the definitive guide to deadlines and due dates for the course.  I will try to reinforce these on the learning management system but that is only a secondary convenience and should not be relied on exclusively.

Non-Class Time
You need to budget time outside of class to complete the reading and work on assignments.  Complete the reading for each week prior to the corresponding class meeting.  Note, many students find it helpful to read some materials more than once.  Only the first time through the reading need precede the corresponding class. If you have questions about the material, please post them to the Discussion Forum designated for questions about research design and methods (or email me and I will post an anonymous version of your question with my answer).  If my answer does not fully resolve your question, please follow-up with a revised question.  Do not wait until the last minute to turn in assignments because the learning management system can experience service interruptions and your personal technology can also glitch at inopportune times.

Remember that the more you think about how material connects with other things, the better you are able to remember it.  As you work through the material from this course, I encourage you to think about how it applies to research that you read about in other courses.

Asking effective questions:  Try to formulate questions in an effective manner.  If you ask me to explain some topic, especially a fairly general one, I will probably give a brief overview and refer you to the appropriate passages from the textbook or instructional materials.  This is not an effective question (unless that is what you are after) because you are not giving me clear information about what you do not understand, leaving me to guess or just duplicate what you can find elsewhere.  If something was unclear to you there, it is likely to be equally unclear in my answer.  Instead, try to be as specific as you can about what you do not understand.  If you do not understand a particular term, tell me what you find confusing about it.  If you do not understand a particular sentence or paragraph, cite the passage and explain why it does not make sense to you.  If you are confused about a particular method or concept, given an example and indicate what you think that the options are.  The more context and detail that you can give me, the better the chances that I can give an answer that is helpful and informative to you and to other students in the class with similar questions.

If your question is related to an assignment, phrase your question in a way that does not involve any spoilers for other students working on the same assignment.  If in doubt, email me privately rather than directly posting on a discussion board.  I will then paste an anonymized and, if necessary, edited version of the question and answer to the discussion board.

Feel free to search for answers to your questions on the Web.  However, please do not attempt to post questions related to the course using online fora like Cross Validated or Stack Overflow.  These are precious resources maintained by busy people donating their time and expertise.  It is not appropriate to lean on them for questions related to a course when you have ready access to an instructor.  Save that for later in your career when you are no longer a student.  (Also, you will probably get a terse answer that either refers you to introductory material or assumes more background knowledge than you currently have.)  You should be able to complete assignments based on the provided course materials but if you make use of additional resources be sure to credit them in what you turn in (see Academic Integrity).

Everyone from me to your class mates are depending on you to ask questions when you have them.  If you have a question, you can be fairly certain that others have the same question.  Your question is not a "dumb question" but asking the question is the smartest thing that you can do.  Everyone else will appreciate your having asked the question.

Class Time
The course design is a partially "flipped classroom".  I will not lecture.  We will use class time to answer your questions and complete in-class exercises to help reinforce learning.  (However, you will still need to devote time outside of class to completing assignments.)  The course is designed to help you actively engage with the material so that you will understand it better and remember it longer. 

If you have questions about the reading, in addition to posting them online, you can bring them to class and I will try to answer them there.  I want to leave some flexibility to use the class time in the manner you will find most useful, the more questions you ask, the more class time will be devoted to answering them.

Academic Integrity Attestation
This is a non-graded course requirement.  No other assignments will be accepted for credit unless this form is completed, signed and submitted.  The form is available on the learning management system and attests that you understand the principles of academic integrity and will abide by them in completing all course work involved in this course.  (See further information near the end of the syllabus.)
Note: Submitting work generated by a generative artificial intelligence program has been interpreted as both plagiarism and cheating under existing CUNY policy.  It constitutes submitting work from another source as your own work.  That is, you should not consider generative artificial intelligence to be a tool that you use to write, like a grammar checker or spell checker.  You should consider it a source like a book or article and apply the same rules for attribution, citation and quotation.  (I would think of generative AI as similar to Wikipedia, it may help you find other sources but is probably not the source you want to cite for a given piece of information or idea, it is a secondary source and you should seek out the primary source in most cases.)

Introduction
Post to the designated discussion forum on the learning management system to introduce yourself to the class.  Tell us (a) your name, (b) which program you are in, (c) what career interests or goals you have for after you graduate, (d) what you would like to do for a thesis or externship, and (e) what you hope to get out of the course.

Reader's Log Entries
There is a Reader's Log entry for each assigned chapter from the text book.  Complete these along with the corresponding reading before the corresponding class meeting (see Schedule for due dates and times).  Each Reader's Log entry should be between 200 and 300 words (i.e., 250 plus or minus 50, about one page).

Each Reader's Log entry should have the following components:
(a) Explain a concept of your choice from the chapter.
(b) Explain a second concept of your choice from the chapter.
(c) Explain how the two concepts are related in some way (e.g., conceptually, procedurally, in terms of their goals or purposes, historically, etc.).
(d) Use a concrete example to illustrate how they are related. 
  

Poster One

Poster I relates to Parts I and II of the course. 

Step 1: Select and register a research article
Choose a research article from a peer reviewed journal that has not already been chosen by another student.  To check that a journal is peer reviewed, find the journal's web page and look at the journal description and/or instructions to authors.  The study reported in the article must use either an experimental, nonexperimental or quasi-experimental design and include at least one measured variable.  Post your choice of research article to the associated Discussion Forum on the Learning Management System course site.  Use the citation for the article as your subject heading.  Include the full reference for the article in the body of your post.  If you do not know the difference between a citation and reference, look it up online.  If you do not have a copy of the APA Publication Manual, the Library lists useful resources here: https://guides.lib.jjay.cuny.edu/c.php?g=288322&p=7472824

Step 2: Create and upload your poster
Submit your poster as a PDF (Portable Document Format) file.  One popular approach is to create the poster using presentation software such as PowerPoint.  Set the page size to 3 feet tall by 4 feet wide (36 x 48).  You can also create tables or figures in other software and paste them into the editable document.  When you are done, save, print, or export to PDF format.  It usually works best to organize the poster into three columns.  You can find examples onlne.  You may also find the following short article helpful: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8258719/

Poster One should have the following elements:
(a) A header that contains the title of the poster, your name, and your affiliation (John Jay College of Criminal Justice, CUNY).
(b) A section labeled "Abstract" providing a summary of the entire poster (100-200 words).  Summarize the content, do not just list topics covered.
(c) A section labeled "Research Report" that summarizes the study from the research report that you chose including the citation, a brief description of the methodology, and a brief description of the main results.  If you chose an article with multiple studies, just pick one (that meets the above requirements) for the poster. (findings; 100-200 words).
(d) A section labeled "Study Design" that focuses on the study design.  Clearly identify whether the study uses and (a) experimental, (b) nonexperimental or (c) quasi-experimental design and cite specific sentences form the report that provide textual evidence to support your categorization of the design.  Identify the independent and dependent variables in the design. (150-250 words)
(e) A section labeled "Design Evaluation" that clearly states two strengths and two weaknesses of the design.  Use specific details from the study to describe these strengths an weaknesses.  Note that Part I and Part II of the course involve numerous features that distinguish better from worse psychological research, all of which are fair game for this section of the poster.  If you draw a blank, read through the table of contents or chapter summaries to jog your memory and give you ideas for possible strengths and weaknesses. (200-300 words)
(h) A section labeled "Conclusion" that provides a summary and conclusion for the entire poster (100-200 words)
(i) A section labeled "References" that provides the full reference for the research article and any other cited sources (as long as needed but try not to exceed 5 references).

Poster Two
Poster Two relates to Parts III and IV of the course.  Follow the general poster instructions from Poster I.

Step 1:  Register your research report (as with Poster One).  Be sure to choose a study that reports at least on descriptive statistic and at least on inferential statistic (which you can usually recognize by either a p value or a confidence level for a confidence interval, denoted as C).

Step 2:  Upload your poster (general format and requirements as with Poster One).

Poster Two should have the following elements:

(a) A header (as above).

(b)
A section labeled "Abstract" providing a summary of the entire poster (100-200 words).  Summarize the content, do not just list topics covered.
(c) A section labeled "Research Report" that summarizes the study from the research report that you chose including the citation, a brief description of the methodology, and a brief description of the main results.  If you chose an article with multiple studies, just pick one (that meets the above requirements) for the poster. (findings; 100-200 words).
(d) Use one of the outline formats listed on the Wikipedia page for outlines (https://en.wikipedia.org/wiki/Outline_(list)) to outline all the headings in the research report.  Use the different levels of the outline to distinguish different levels of headings used in the report.
(e) A section labeled "Heading Analysis" that refers to the outline from part d to provide a verbal description of how the report is organized.  Critically evaluate what is effective and what is less effective about how it is organized. (150-250 words)
(f)
Choose a descriptive statistic from the report and describe the following in a section labeled "Descriptive Statistic" (250-350 words):
  (i) What substantive variable is summarized by the statistic?
  (ii) What is the level of measurement of the variable that is summarized (nominal, ordinal, interval or ratio)?
  (iii) What kind of statistic is it that does the summarizing (e.g., frequency, proportion, mean, standard deviation)?
  (iv) Interpret the value of the statistic with respect to the sample.
(g) Choose an inferential statistic from the report and describe the following in a section labeled "Inferential Statistic" (250-350 words):
  (i) State the null hypothesis and alternative hypothesis.  (The alternative hypothesis is often just the negation of the null hypothesis, except for one-sided tests, and the null hypothesis is typically the hypothesis with an equals sign (=) asserting a specific value for the parameter of interest.  Nil null hypotheses are the norm in psychology, in which case the parameter equals zero. (A nil null hypotheses can also use nonzero values if they correspond to no effect, association or difference.  For example, if a - b = 0, then a / b = 1, so a nil null hypotheses about a ratio might assert that it equals one.)
  (ii) Report the value of the statistic along with any degrees of freedom and the p value.  (Note z tests do not have degrees of freedom, confidence intervals do not have p values but should report a confidence level [C = 1 - alpha], a lower bound and an upper bound.)
  (iii) Describe the interpretation that the author(s) give to the inferential statistic (i.e., the conclusion that they draw regarding the hypothesis).
(h) In a section labeled "Proposed Follow-up" briefly describe a design for a follow-up study to the study you chose (it can be a replication with some differences in context, an extension, or a study of a new question raised by the study you chose).  Describe the hypothesis you want to test (remember, hypotheses are always about the population) and explain how you proposed design will test this hypothesis.  (200-300 words)
(i)
A section labeled "Conclusion" that provides a summary and conclusion for the entire poster (100-200 words)
(j) A section labeled "References" that provides the full reference for the research article and any other cited sources (as long as needed but try not to exceed 5 references).


In-class Practice Problems

We will work on practice problems in class.  These will sometimes involve materials distributed on the learning management system.  We will meet in a regular classroom.  I can project these materials on the screen from the podium computer.  However, you may find it helpful to bring a device to class that can download files from the learning management system.

Attendance
The students who get the most out of the course recognize that attending class is its own reward and helpful in mastering the material.  At the same time, if you have Covid, the flu, or another infectious illness, please remain home until you are healthy.  Likewise, if you need to miss a class for other legitimate reasons, that is perfectly okay.  You will not loose credit for missing class but you can earn extra credit by attending class regularly.  If on occasion you need to miss class, a head's up in an email message beforehand is greatly appreciated.

Grading
All grades in this course are reported on a proportion metric, which is like a percentage divided by 100 and ranges from 0 to 1.

Caution: All grades are contingent on your submitting the required Academic Integrity Attestation form.  I will not accept assignments for a grade without a signed form.

I will drop your two lowest Reader's Log grades before summing the rest and dividing by 11 (there are 13 total).  If you are happy with your grades on the first 11, you are welcome but not obliged to submit the last two.

I will compute your attendance score ignoring the first two weeks and dividing the number of remaining class meetings attended by 13.

Your Numeric Course Grade is calculated from the above scores as follows:  (.1 * Introduction) + (.45 * Reader's Log Total) + (.225 * Poster I) + (.225 * Poster II) + (.05 * Attendance).  In words, your introduction post counts for one tenth of your course grade, the Reader's Logs count 45 percent, each of the two posters counts 22.5 percent (which sums to 45 percent), and attendance gives you the opportunity for 5 percent extra credit to make up for points lost elsewhere.  There will be no other extra credit options beyond attendance.

I will use the following chart to convert Numeric Course Grades to Letter Course Grades.  On the proportion (not percent) scale, I will round .xx5 and above up and anything below .xx5 down.

Letter Grade  Numeric Course Grade
A .95-1.00
A- .90-.94
B+ .85-.89
B .80-.84
B- .75-.79
C+ .70-.74
C .65-.69
C- .60-.64
F .00-.59

 
You can use the below grade calculator to estimate your course grade.  This requires a web browser that supports JavaScript.

Grade Calculator
Attendance Grade  
Introduction Grade    
Reader's Log Grade  
Poster I Grade   
Poster II Grade    
Numeric Course Grade  
Letter Course Grade  

All grades expressed as a proportion.  Numeric Course Grade rounded to 6 decimals.


Inappropriate Helping
Many of you have chosen the course of study you have because you wish to join what is commonly known as "the helping profession."  To become a valued member of this profession, it is crucial that you learn to distinguish appropriate from inappropriate helping.  Success in this field of work requires the trust of your colleagues and coworkers.  Whether you are doing counseling or intake assessments or something in between, the work you do on a daily basis impacts people's lives, and your coworkers need to know that you will do that work with integrity.  It may seem harmless to share answers but in doing so you are engaging in inappropriate helping.  You are harming the person who receives the answers by denying them the opportunity to learn from the course assignments.  You are harming yourself by forming dysfunctional work habits that could damage your career down the line.  You are also doing harm to other students and the College by damaging the reputation of the college and reducing the value of the degrees that it grants.  Finally, you are harming your prospective employers by undermining their trust that a degree from the College represents the knowledge, skills and abilities that they expect when they hire one of our graduates.  So, what seems like a harmless act of "helping" can actually end up doing a lot of harm. 

The expectation in this course is that you will do your own work.  It is allowed and encouraged that you form study groups, discuss the material, work together on unassigned problems from the book, even practice testing one another on the material.  However, all graded assignments must be completed individually with no collaboration or sharing of work.  If you cannot respect the boundary between appropriate and inappropriate helping, then I encourage you to drop the course to avoid ruining it for others.

College Plagiarism Policy
Plagiarism is the act of presenting another person’s ideas, research or writings as your own. The following are some examples of plagiarism, but by no means is it an exhaustive list:

•    Copying another person’s actual words without the use of quotation marks and footnotes attributing the words to their source

•    Presenting another person’s ideas or theories in your own words without acknowledging the source

•    Using information that is not common knowledge without acknowledging the source

•    Failing to acknowledge collaborators on homework and laboratory assignments

Internet plagiarism includes submitting downloaded term papers or part of term papers, paraphrasing or copying information from the Internet without citing the source, and “cutting and pasting” from various sources without proper attribution.

(From the John Jay College of Criminal Justice Graduate Bulletin, p. 89)

Students who are unsure how and when to provide documentation are advised to consult with their instructors. The Library has free guides designed to help students with problems of documentation.

Note:  In the past some students have bumbled into plagiarism by relying on Internet searches to complete application assignments instead of relying on the assigned materials.  If two students use the same Internet resource, then the result is assignments that look like they collaborated.  As such, avoid copying examples from other sources and make up your own examples for assignments.  If you do rely on the Internet, then always cite the Internet sources that you use in your assignment (including the URLs).  Also be aware that the assignments are tailored to the assigned learning materials whereas Internet resources are typically aimed at a more advanced audience, assume more background and cover material that is beyond the scope of the course.

Contact Information: (It usually works best to email me.)

  Office Hours:  By appointment.  I will dedicate a Blackboard Discussion Board to questions and check it several times a week.  For anything that you do not want to share with other students, contact me by email.  I can answer many questions quickly by email (I will post an anonymous version to Blackboard for course-related questions.)

  Office:  Room 10.65.04, 524 W59 Street, New York, NY 10019 USA

  Phone:  212-237-8784 Please do not leave messages at this number.  (I do not check voice mail when off campus and I no longer receive voicemail as email for some reason.)  If possible, please use email.

  Email:  KMarkus@aol.com

(Email sent to kmarkus@jjay.cuny.edu will generally forward to me, sometimes with a delay.  However, college email does not always comply with the DMARC email standards which sometimes results my my receiving an error message about rejected email instead.)

 

Schedule

Week
Section 01 Wednesday
Meeting Dates
Assignments
All assignments due by 5:PM on the date listed in the meeting dates column unless otherwise noted.
Reading
Topics
1
1/31


Why am I here?  What is this class about?  Syllabus.
2
2/7
Introduction (Discussion Board Post)
Ch1 Reader's Log
Ch1

Part I: Preliminaries
The science of psychology
3
2/14
Ch2 Reader's Log
Attestation of Academic Integrity
Ch2

Scientific method
4
2/21
Ch3 Reader's Log Ch3
Research ethics
5
3/6
(2/28 follows Monday schedule)
Ch4 Reader's Log Ch4

Psychological measurement
6
3/13
Ch5 Reader's Log
(Recommended target date for registering Poster One research article)
Ch5

Part II: Basic Design Types
Experimental research
7
3/20
Ch6 Reader's Log

Ch6

Non-experimental research (excluding quasi-experiments)
8
3/27
Ch7 Reader's Log Ch8(!)

Quasi-experimental research
9
4/3
Ch8 Reader's Log
Poster One

Ch7

Part III:  Special topics
Survey research (this is a data collection method, not a design)
10
4/10
Ch9 Reader's Log Ch9
Factorial designs
11
4/17
Ch10 Reader's Log Ch 10
Single-subject research designs
12
5/1
(4/24 Spring Break)
Ch11 Reader's Log
(Recommended target date for registering Poster Two research article)
Ch 11
Part IV: Related professional skills
Presenting your research
13
5/8
Ch12 Reader's Log Ch 12
Descriptive statistics
14
5/15
Ch13 Reader's Log Ch 13
Inferential statistics
15 (Finals week)
5/22 
Poster Two (Come to class prepared to talk for 2-3 minutes about your proposed follow-up study, part h.)


 
Source:
https://www.jjay.cuny.edu/academics/academic-resources-services/registrar/academic-calendar
http://www.cuny.edu/academics/academic-calendars/

Americans with Disabilities Act (ADA) CUNY Accommodations Policy
Students who believe that they may need an accommodation due to a disability are encouraged to immediately contact the Office of Accessibility Services (OAS) in room L.66 NB (212-237-8031 or accessibilityservices@jjay.cuny.edu).  Students are welcome but not required to speak with the instructor privately to discuss specific needs for the class. Students with disabilities are entitled to confidentiality over disability-related status or details. Students are not required to disclose their specific disability to their instructors or anyone else.

Wellness and Student Resources
Students experiencing any personal, medical, financial or familial distress, which may impede their ability to fulfill the requirements of this course, are encouraged to visit the Wellness Center (L.65 NB). Available resources include Counseling Services, Health Services, Food Bank, and emergency funding support. See http://www.jjay.cuny.edu/wellness-resources

Resources for Reporting Sexual Harassment, Sexual Assault, Stalking, or Domestic and Dating/Intimate Partner Violence
The individuals below are available to discuss your rights and the resources available to you as well as help you explore your options for reporting sexual misconduct, harassment or discrimination of any kind:
1. Gabriela Leal, Title IX Coordinator, 646-557-4674, gleal@jjay.cuny.edu 
2. Diego Redondo, Director of Public Safety & Risk Management, 212-237-8524, dredondo@jjay.cuny.edu
3. Michael Martinez-Sachs, Dean of Students, 212-237-8211, msachs@jjay.cuny.edu
To speak confidentially, you may contact Women's Center Counselor and Gender-Based Violence Prevention and Response Advocate, Jessica Greenfield, jgreenfield@jjay.cuny.edu. For more information, please see CUNY’s Policy on Sexual Misconduct (PSM), or refer to this Q &A document.




Links

Site Map
John Jay Home Page
Top


 
Created 12 January 2024
Updated 18 January 2024, 24 January 2024, 31 January 2024
Created and tested using SeaMonkey 2.53.17
Syllabus is subject to change until the day of the first class meeting.