{"id":10345,"date":"2017-11-03T07:11:35","date_gmt":"2017-11-02T22:11:35","guid":{"rendered":"http:\/\/ibpsych.themantic-education.com\/?p=10345"},"modified":"2020-03-22T11:44:47","modified_gmt":"2020-03-22T02:44:47","slug":"so-you-want-to-assess-population-validity","status":"publish","type":"post","link":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/","title":{"rendered":"So you want to assess population validity?"},"content":{"rendered":"<blockquote><p>&nbsp;<\/p><\/blockquote>\n<p>If you&#8217;re reading this it might be because you&#8217;ve written something like this in your answer and tried to fob it off as critical thinking:<\/p>\n<p><span style=\"color: #000080;\"><em>&#8220;One of the limitations of this study was that it has a small sample size and so lacks population validity.&#8221;\u00a0<\/em><\/span><\/p>\n<p>The thing to remember when trying to show critical thinking is that <em><strong>it takes time<\/strong><\/em>. It&#8217;s not easy. It&#8217;s what separates the students who get 4s and 5s from those who get 6s and 7s. If it was easy as writing the statement above, a lot more than 4% of IB Psychology students would get 7s. But it&#8217;s not that easy.<\/p>\n<blockquote><p><em>If you&#8217;re wondering whether or not you&#8217;ve made a good critical thinking point, ask yourself honestly: how hard did I have to think to come up with that idea?<\/em><\/p><\/blockquote>\n<p><strong>Read more:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/www.themantic-education.com\/ibpsych\/2017\/04\/15\/so-you-want-to-assess-ecological-validity\/\">So you want to assess ecological validity?<\/a><\/li>\n<li><a href=\"https:\/\/www.themantic-education.com\/ibpsych\/2019\/11\/11\/how-to-evaluate-any-study-in-3-simple-steps\/\">How to evaluate any study in 3 simple steps<\/a><\/li>\n<li><a href=\"https:\/\/www.themantic-education.com\/ibpsych\/2018\/05\/21\/so-you-want-to-assess-ethical-considerations\/\">So you want to assess ethical considerations?<\/a><\/li>\n<\/ul>\n<hr \/>\n<p><strong>What is &#8220;population validity?&#8221;<\/strong><\/p>\n<p>What we&#8217;re assessing with population validity is <strong>generalizability<\/strong>: can we generalize (apply) these results to people beyond the sample? In other words, would I expect that the same results would happen if the procedures were carried out on a different group of people?<\/p>\n<p>For example, most psychological study participants are college-aged, middle-class, white, Americans. Would results from a study using participants like this be generalizable to all Americans? What about people from other cultures?<\/p>\n<p>Population validity is a type of <strong>external validity.\u00a0<\/strong>This means that we&#8217;re assessing the extent to which the results from the study are valid and applicable\u00a0<em>beyond\u00a0<\/em>the study itself. A small sample size may affect this because the smaller the sample the more potential there is for individual results and outliers to affect averages. The larger the sample the less outliers will impact the results.<\/p>\n<div id=\"attachment_10422\" style=\"width: 310px\" class=\"wp-caption alignright\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-10422\" class=\"alignnone size-medium wp-image-10422\" src=\"https:\/\/i0.wp.com\/blogs.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-178852840.jpg?resize=300%2C200&#038;ssl=1\" alt=\"Thai girls splashing water during festival Songkran festival\" width=\"300\" height=\"200\" srcset=\"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-178852840.jpg?w=4997&amp;ssl=1 4997w, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-178852840.jpg?resize=300%2C200&amp;ssl=1 300w, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-178852840.jpg?resize=768%2C512&amp;ssl=1 768w, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-178852840.jpg?resize=1024%2C683&amp;ssl=1 1024w, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-178852840.jpg?w=1572&amp;ssl=1 1572w, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-178852840.jpg?w=2358&amp;ssl=1 2358w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><p id=\"caption-attachment-10422\" class=\"wp-caption-text\">If you are evaluating a study conducted on Americans and you come from a different culture, one way to start thinking about population validity is to wonder whether you&#8217;d expect the same results in your culture.<\/p><\/div>\n<hr \/>\n<h2><strong>3 steps to assess population validity<\/strong><\/h2>\n<p><strong>Step One: Knowing the participants<\/strong><\/p>\n<p>As with all critical thinking, it begins with asking some questions. An important one is:<\/p>\n<ul>\n<li>Who were the participants in the study?<\/li>\n<\/ul>\n<p>This is where it&#8217;s important that you know the methodology. What characteristics do you know about the participants. This could be their gender, nationality, age, cultural background, race, religion, health background, etc.<\/p>\n<blockquote><p><em>I would recommend focusing on the characteristics of the participants instead of the number of participants, since it gives you more potential to show deep critical thinking.\u00a0<\/em><\/p><\/blockquote>\n<p><strong>Step Two: Questioning generalizability<\/strong><\/p>\n<p>After you&#8217;ve identified key characteristics, the second question to ask would be:<\/p>\n<ul>\n<li>Who are we trying to generalize these results to?<\/li>\n<\/ul>\n<p>Here&#8217;s where you have to identify a second group because population validity is about seeing if the results can apply from one group (the sample) to another population (group of people).<\/p>\n<p>The second group should be related to the first to make it easier to explain. For example, if you identify that the sample had a mean age of only 24, you can start thinking about why these results might not apply to an older group of people. If they were all females, why might we question the validity of generalizing these results to males? If the participants were white Americans, why might we not expect the same results with other cultural groups?<\/p>\n<blockquote><p><em>It&#8217;s fine to ask questions in the &#8220;red zone&#8221; critical thinking areas of your essays &#8211; but it&#8217;s\u00a0<strong>far better\u00a0<\/strong>if you can answer your own questions, too!\u00a0<\/em><\/p><\/blockquote>\n<p><strong>Step Three: <em>Explaining<\/em> issues with generalizability\u00a0<\/strong><\/p>\n<p>Now that you&#8217;ve asked a good question about a group that we might not expect the same results with, it&#8217;s time give some reasons why you might not expect the same results. This requires you to know something about the group in question and to really think carefully about why the results might not apply.<\/p>\n<p>If focusing on culture, why might we not expect the same results with a different culture? Do they have different values that might have an effect?<\/p>\n<p>If only one gender was studied, why might we not expect the same results with the other gender? Is there something biological that could be an issue, or perhaps the way they think might be different.<\/p>\n<p>Below you&#8217;ll see a good example of how to<em> explain\u00a0<\/em>an issue with generalizability.<\/p>\n<hr \/>\n<h2>Examples<\/h2>\n<p><em>The following examples are based on Radke et al.&#8217;s (2015) study that shows increases in testosterone can increase amygdala activity when we&#8217;re responding to a social threat. Imagine this has just been used in an essay explaining how testosterone can affect aggression. The answer is now moving into the counter-argument stage of the essay.<\/em><\/p>\n<p><span style=\"color: #00ccff;\"><strong>Weak:\u00a0<\/strong>One limitation of this study is that the participants were all females. This means it lacks population validity as we can&#8217;t generalize to males.<\/span><\/p>\n<p><span style=\"color: #3366ff;\"><strong>Better:\u00a0<\/strong>One limitation of this study is that it might lack population validity because the participants were all females. Could we expect the same results with males? There are a number of biological differences between males and females that could affect these results. Males may also be raised differently so they have different attitudes about aggression, so this could affect the relationship between testosterone and the amygdala.<\/span><\/p>\n<p><span style=\"color: #000080;\"><strong>Best:\u00a0<\/strong>One limitation of this study is that it was conducted on all females so the results might lack population validity. One reason we might not expect the same results in males is that testosterone is the male sex hormone and more is produced in the testes in males than the ovaries in females. Because males have naturally higher levels of testosterone, perhaps their brains would respond differently as they&#8217;ve adapted to these levels over time. We know that the brain can change as a result of experience (neuroplasticity), so it&#8217;s plausible to think that maybe male brains have adapted to higher levels of testosterone than females and so the same reaction might not be observed.<\/span><\/p>\n<hr \/>\n<p>There are a few things I hope you can learn from this explanation and the above examples:<\/p>\n<ol>\n<li>Critical thinking requires <em>critical thinking!<\/em><\/li>\n<li>Start by asking questions<\/li>\n<li>Critical thinking is dependent on knowledge: if you don&#8217;t know the methods of studies, you can&#8217;t critically evaluate them<\/li>\n<li>It&#8217;s OK to ask questions, but it&#8217;s even better if you can answer them<\/li>\n<\/ol>\n<hr \/>\n<p>Was this helpful? Hit the &#8220;like&#8221; button if it was.<\/p>\n<p>Got a question or feedback? Post it in the comments.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&nbsp; If you&#8217;re reading this it might be because you&#8217;ve written something like this in your answer and tried to fob it off as critical thinking: &#8220;One of the limitations of this study was that it has a small sample size and so lacks population validity.&#8221;\u00a0 The thing to remember when trying to show critical thinking is that it takes &#8230; <\/p>\n<div><a href=\"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/\" class=\"more-link\">Read More<\/a><\/div>\n","protected":false},"author":3,"featured_media":10420,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rs_blank_template":"","rs_page_bg_color":"","slide_template_v7":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[31,35],"tags":[],"class_list":["post-10345","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-revision-and-exam-preparation","category-teaching-ideas"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>So you want to assess population validity? | The IB Psychology Blog<\/title>\n<meta name=\"description\" content=\"Learn how to assess population validity in 3 simple steps and understand its importance in generalizing study results. Develop critical thinking skills to evaluate studies and ask relevant questions. Like and comment for more helpful tips.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"So you want to assess population validity? | The IB Psychology Blog\" \/>\n<meta property=\"og:description\" content=\"Learn how to assess population validity in 3 simple steps and understand its importance in generalizing study results. Develop critical thinking skills to evaluate studies and ask relevant questions. Like and comment for more helpful tips.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/\" \/>\n<meta property=\"og:site_name\" content=\"The IB Psychology Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/facebook.com\/themanticeducation\/\" \/>\n<meta property=\"article:published_time\" content=\"2017-11-02T22:11:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-03-22T02:44:47+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1\" \/>\n\t<meta property=\"og:image:width\" content=\"900\" \/>\n\t<meta property=\"og:image:height\" content=\"600\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Travis Dixon\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Travis Dixon\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/\"},\"author\":{\"name\":\"Travis Dixon\",\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/#\\\/schema\\\/person\\\/de20f76afd22df7d71e141ab515c0827\"},\"headline\":\"So you want to assess population validity?\",\"datePublished\":\"2017-11-02T22:11:35+00:00\",\"dateModified\":\"2020-03-22T02:44:47+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/\"},\"wordCount\":1114,\"commentCount\":2,\"publisher\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i0.wp.com\\\/www.themantic-education.com\\\/ibpsych\\\/wp-content\\\/uploads\\\/sites\\\/3\\\/2017\\\/11\\\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1\",\"articleSection\":[\"Revision and Exam Preparation\",\"Teaching Ideas\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/\",\"url\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/\",\"name\":\"So you want to assess population validity? | The IB Psychology Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i0.wp.com\\\/www.themantic-education.com\\\/ibpsych\\\/wp-content\\\/uploads\\\/sites\\\/3\\\/2017\\\/11\\\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1\",\"datePublished\":\"2017-11-02T22:11:35+00:00\",\"dateModified\":\"2020-03-22T02:44:47+00:00\",\"description\":\"Learn how to assess population validity in 3 simple steps and understand its importance in generalizing study results. Develop critical thinking skills to evaluate studies and ask relevant questions. Like and comment for more helpful tips.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/#primaryimage\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/www.themantic-education.com\\\/ibpsych\\\/wp-content\\\/uploads\\\/sites\\\/3\\\/2017\\\/11\\\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i0.wp.com\\\/www.themantic-education.com\\\/ibpsych\\\/wp-content\\\/uploads\\\/sites\\\/3\\\/2017\\\/11\\\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1\",\"width\":900,\"height\":600,\"caption\":\"Population validity requires asking questions about how the results might be applicable to populations of people other than the study sample. Culture is one important factor to consider.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/2017\\\/11\\\/03\\\/so-you-want-to-assess-population-validity\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"So you want to assess population validity?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/#website\",\"url\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/\",\"name\":\"IB Psychology\",\"description\":\"by Themantic Education\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/#organization\",\"name\":\"Themantic Education\",\"url\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/www.themantic-education.com\\\/ibpsych\\\/wp-content\\\/uploads\\\/sites\\\/3\\\/2019\\\/06\\\/them-ed-logo.png?fit=1465%2C1858&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i0.wp.com\\\/www.themantic-education.com\\\/ibpsych\\\/wp-content\\\/uploads\\\/sites\\\/3\\\/2019\\\/06\\\/them-ed-logo.png?fit=1465%2C1858&ssl=1\",\"width\":1465,\"height\":1858,\"caption\":\"Themantic Education\"},\"image\":{\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/facebook.com\\\/themanticeducation\\\/\",\"https:\\\/\\\/youtube.com\\\/c\\\/themanticeducation\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/#\\\/schema\\\/person\\\/de20f76afd22df7d71e141ab515c0827\",\"name\":\"Travis Dixon\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/6ee7465953db9edfb653802c2423ee0be4456f3cf73a4ae4032bdda760a9a5e0?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/6ee7465953db9edfb653802c2423ee0be4456f3cf73a4ae4032bdda760a9a5e0?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/6ee7465953db9edfb653802c2423ee0be4456f3cf73a4ae4032bdda760a9a5e0?s=96&d=mm&r=g\",\"caption\":\"Travis Dixon\"},\"description\":\"Travis Dixon has been teaching for over 20 years and is an experienced IB Psychology, History and English teacher, author, workshop leader and examiner\",\"url\":\"https:\\\/\\\/www.themantic-education.com\\\/ibpsych\\\/author\\\/tdixon\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"So you want to assess population validity? | The IB Psychology Blog","description":"Learn how to assess population validity in 3 simple steps and understand its importance in generalizing study results. Develop critical thinking skills to evaluate studies and ask relevant questions. Like and comment for more helpful tips.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/","og_locale":"en_GB","og_type":"article","og_title":"So you want to assess population validity? | The IB Psychology Blog","og_description":"Learn how to assess population validity in 3 simple steps and understand its importance in generalizing study results. Develop critical thinking skills to evaluate studies and ask relevant questions. Like and comment for more helpful tips.","og_url":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/","og_site_name":"The IB Psychology Blog","article_publisher":"https:\/\/facebook.com\/themanticeducation\/","article_published_time":"2017-11-02T22:11:35+00:00","article_modified_time":"2020-03-22T02:44:47+00:00","og_image":[{"width":900,"height":600,"url":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1","type":"image\/jpeg"}],"author":"Travis Dixon","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Travis Dixon","Estimated reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/#article","isPartOf":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/"},"author":{"name":"Travis Dixon","@id":"https:\/\/www.themantic-education.com\/ibpsych\/#\/schema\/person\/de20f76afd22df7d71e141ab515c0827"},"headline":"So you want to assess population validity?","datePublished":"2017-11-02T22:11:35+00:00","dateModified":"2020-03-22T02:44:47+00:00","mainEntityOfPage":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/"},"wordCount":1114,"commentCount":2,"publisher":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/#organization"},"image":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1","articleSection":["Revision and Exam Preparation","Teaching Ideas"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/","url":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/","name":"So you want to assess population validity? | The IB Psychology Blog","isPartOf":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/#primaryimage"},"image":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1","datePublished":"2017-11-02T22:11:35+00:00","dateModified":"2020-03-22T02:44:47+00:00","description":"Learn how to assess population validity in 3 simple steps and understand its importance in generalizing study results. Develop critical thinking skills to evaluate studies and ask relevant questions. Like and comment for more helpful tips.","breadcrumb":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/#primaryimage","url":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1","contentUrl":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1","width":900,"height":600,"caption":"Population validity requires asking questions about how the results might be applicable to populations of people other than the study sample. Culture is one important factor to consider."},{"@type":"BreadcrumbList","@id":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/11\/03\/so-you-want-to-assess-population-validity\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.themantic-education.com\/ibpsych\/"},{"@type":"ListItem","position":2,"name":"So you want to assess population validity?"}]},{"@type":"WebSite","@id":"https:\/\/www.themantic-education.com\/ibpsych\/#website","url":"https:\/\/www.themantic-education.com\/ibpsych\/","name":"IB Psychology","description":"by Themantic Education","publisher":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.themantic-education.com\/ibpsych\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/www.themantic-education.com\/ibpsych\/#organization","name":"Themantic Education","url":"https:\/\/www.themantic-education.com\/ibpsych\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.themantic-education.com\/ibpsych\/#\/schema\/logo\/image\/","url":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2019\/06\/them-ed-logo.png?fit=1465%2C1858&ssl=1","contentUrl":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2019\/06\/them-ed-logo.png?fit=1465%2C1858&ssl=1","width":1465,"height":1858,"caption":"Themantic Education"},"image":{"@id":"https:\/\/www.themantic-education.com\/ibpsych\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/facebook.com\/themanticeducation\/","https:\/\/youtube.com\/c\/themanticeducation\/"]},{"@type":"Person","@id":"https:\/\/www.themantic-education.com\/ibpsych\/#\/schema\/person\/de20f76afd22df7d71e141ab515c0827","name":"Travis Dixon","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/6ee7465953db9edfb653802c2423ee0be4456f3cf73a4ae4032bdda760a9a5e0?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/6ee7465953db9edfb653802c2423ee0be4456f3cf73a4ae4032bdda760a9a5e0?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6ee7465953db9edfb653802c2423ee0be4456f3cf73a4ae4032bdda760a9a5e0?s=96&d=mm&r=g","caption":"Travis Dixon"},"description":"Travis Dixon has been teaching for over 20 years and is an experienced IB Psychology, History and English teacher, author, workshop leader and examiner","url":"https:\/\/www.themantic-education.com\/ibpsych\/author\/tdixon\/"}]}},"yoast":{"focuskw":"population validity","title":"","metadesc":"Learn how to assess population validity in 3 simple steps and understand its importance in generalizing study results. Develop critical thinking skills to evaluate studies and ask relevant questions. Like and comment for more helpful tips.","linkdex":"","metakeywords":"","meta-robots-noindex":"","meta-robots-nofollow":"","meta-robots-adv":"","canonical":"","redirect":"","opengraph-title":"","opengraph-description":"","opengraph-image":"","twitter-title":"","twitter-description":"","twitter-image":""},"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/11\/bigstock-native-brazilian-man-from-tupi-188757682.jpg?fit=900%2C600&ssl=1","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":10807,"url":"https:\/\/www.themantic-education.com\/ibpsych\/2018\/05\/10\/7-exam-tips-for-evaluating-studies\/","url_meta":{"origin":10345,"position":0},"title":"7 exam tips for evaluating studies","author":"Travis Dixon","date":"05\/10\/2018","format":false,"excerpt":"When you're preparing for your exams and you're aiming for a 7, here are some tips that will help you study smarter, not harder. Tip #1: Ignore internal validity, including... Hawthorne effect Screw you effect Demand characteristics Participant expectancy effect I think you should avoid focusing on internal validity factors\u2026","rel":"","context":"In &quot;Revision and Exam Preparation&quot;","block_context":{"text":"Revision and Exam Preparation","link":"https:\/\/www.themantic-education.com\/ibpsych\/category\/revision-and-exam-preparation\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/05\/paper-and-a-pencil-1467185321xps.jpg?fit=1200%2C800&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/05\/paper-and-a-pencil-1467185321xps.jpg?fit=1200%2C800&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/05\/paper-and-a-pencil-1467185321xps.jpg?fit=1200%2C800&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/05\/paper-and-a-pencil-1467185321xps.jpg?fit=1200%2C800&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/05\/paper-and-a-pencil-1467185321xps.jpg?fit=1200%2C800&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":10679,"url":"https:\/\/www.themantic-education.com\/ibpsych\/2018\/02\/25\/lesson-idea-generalizability-external-validity\/","url_meta":{"origin":10345,"position":1},"title":"Lesson Idea: Generalizability (External Validity)","author":"Travis Dixon","date":"02\/25\/2018","format":false,"excerpt":"The Task Read the following fictional\u00a0summaries of how people have applied results from psychological studies. Identify one or more reasons why the application is misguided and might not work. #1 Social Media and Anxiety:\u00a0One study in the USA showed a\u00a0correlation between social media and anxiety so a school in Japan\u2026","rel":"","context":"In &quot;Research Methodology&quot;","block_context":{"text":"Research Methodology","link":"https:\/\/www.themantic-education.com\/ibpsych\/category\/research-methodology\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/02\/bigstock-178852840.jpg?fit=1200%2C800&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/02\/bigstock-178852840.jpg?fit=1200%2C800&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/02\/bigstock-178852840.jpg?fit=1200%2C800&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/02\/bigstock-178852840.jpg?fit=1200%2C800&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2018\/02\/bigstock-178852840.jpg?fit=1200%2C800&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":2802,"url":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/04\/15\/so-you-want-to-assess-ecological-validity\/","url_meta":{"origin":10345,"position":2},"title":"So you want to assess ecological validity?","author":"Travis Dixon","date":"04\/15\/2017","format":false,"excerpt":"If you're reading this it's probably because your teacher has sent you here after reading\u00a0something in your essay along the lines of, \"this experiment was a laboratory experiment and so it lacks ecological validity.\" This throwaway sentence makes teachers and examiners groan (and not award you any marks, just so\u2026","rel":"","context":"In &quot;Assessment (IB)&quot;","block_context":{"text":"Assessment (IB)","link":"https:\/\/www.themantic-education.com\/ibpsych\/category\/assessment-ib\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-143332349.jpg?fit=1200%2C800&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-143332349.jpg?fit=1200%2C800&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-143332349.jpg?fit=1200%2C800&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-143332349.jpg?fit=1200%2C800&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-143332349.jpg?fit=1200%2C800&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":9781,"url":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/10\/26\/t-e-a-c-u-p-and-why-i-dont-use-it\/","url_meta":{"origin":10345,"position":3},"title":"T.E.A.C.U.P&#8230;and why I don&#8217;t use it.","author":"Travis Dixon","date":"10\/26\/2017","format":false,"excerpt":"Yesterday I posted about how to evaluate psychological theories in three simple steps. I mentioned John Crane's popular acronym T.E.A.C.U.P, which stands for: testable, evidence, applications, construct validity, unbiased and predictive validity. (It can be found on John's website, too). This is an alternative to my \"Let's make a DEAL\"\u2026","rel":"","context":"In &quot;Revision and Exam Preparation&quot;","block_context":{"text":"Revision and Exam Preparation","link":"https:\/\/www.themantic-education.com\/ibpsych\/category\/revision-and-exam-preparation\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/10\/teacup.jpg?fit=960%2C682&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/10\/teacup.jpg?fit=960%2C682&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/10\/teacup.jpg?fit=960%2C682&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/10\/teacup.jpg?fit=960%2C682&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":13582,"url":"https:\/\/www.themantic-education.com\/ibpsych\/2020\/11\/10\/generalizability-in-animal-studies-cognition-and-culture\/","url_meta":{"origin":10345,"position":4},"title":"Generalizability in Animal Studies: Cognition and Culture","author":"Travis Dixon","date":"11\/10\/2020","format":false,"excerpt":"Generalizability is the extent to which we can confidently predict the results of a study would apply to a different context, including different people, places, and procedures. When considering the extent to which we can generalize findings from animal studies, we are considering how confidently we could predict the same\u2026","rel":"","context":"In &quot;Biological Psychology&quot;","block_context":{"text":"Biological Psychology","link":"https:\/\/www.themantic-education.com\/ibpsych\/category\/biological-psychology\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2492,"url":"https:\/\/www.themantic-education.com\/ibpsych\/2017\/02\/23\/internal-validity-and-why-i-dont-teach-it\/","url_meta":{"origin":10345,"position":5},"title":"Internal Validity: And why I don&#8217;t teach it&#8230;","author":"Travis Dixon","date":"02\/23\/2017","format":false,"excerpt":"I'd love to hear how you feel about my rationale for not teaching students how to evaluate studies based on internal validity. There is one exception, however: their IA. I only introduce the concept of internal validity during the analysis of their IA results and procedures, as this is the\u2026","rel":"","context":"In &quot;Curriculum&quot;","block_context":{"text":"Curriculum","link":"https:\/\/www.themantic-education.com\/ibpsych\/category\/curriculum\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-university-students-doing-grou-153851090.jpg?fit=1200%2C788&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-university-students-doing-grou-153851090.jpg?fit=1200%2C788&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-university-students-doing-grou-153851090.jpg?fit=1200%2C788&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-university-students-doing-grou-153851090.jpg?fit=1200%2C788&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.themantic-education.com\/ibpsych\/wp-content\/uploads\/sites\/3\/2017\/02\/bigstock-university-students-doing-grou-153851090.jpg?fit=1200%2C788&ssl=1&resize=1050%2C600 3x"},"classes":[]}],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/posts\/10345","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/comments?post=10345"}],"version-history":[{"count":1,"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/posts\/10345\/revisions"}],"predecessor-version":[{"id":12799,"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/posts\/10345\/revisions\/12799"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/media\/10420"}],"wp:attachment":[{"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/media?parent=10345"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/categories?post=10345"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.themantic-education.com\/ibpsych\/wp-json\/wp\/v2\/tags?post=10345"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}