아는 만큼 보인다? : 추천 알고리즘 이용자 태도에 미치는 인지된 지식, 실제 지식, 지식격차 요인의 영향력 탐색
초록
추천 알고리즘은 겉으로 잘 드러나 있지는 않으나, 이용자의 정보환경을 구성하는 데 있어 지속적이고 상당한 영향을 미칠 수 있다. 따라서 미디어 이용자들이 이러한 추천 알고리즘을 올바르게 이해하고 인식하는 것은 매우 중요하다. 특히 추천 알고리즘이 초래할 수 있는 부정적 결과와 편향성을 정확히 인지하고, 이를 비판적으로 바라보는 태도는 추천 알고리즘의 민주적 활용에 있어 필수적이다. 이에 본 연구는 추천 알고리즘 태도에 영향을 미치는 요인에 대한 실증적 탐색을 수행하였다. 구체적으로, 추천 알고리즘에 대한 인지된 지식과 실제 지식이 세 종류의 알고리즘(엔터테인먼트 콘텐츠 추천, 뉴스 추천, 광고 추천)에 대한 태도에 미치는 영향을 살펴보았다. 이에 앞서, ‘지식격차’ 요인으로 제시된 성별, 연령, 소득 및 교육수준, 지역의 (a) 인구사회학적 요인과 (b) 미디어 이용 수준, (c) 디지털 리터러시 수준에 따라 추천 알고리즘에 대한 지식이 어떻게 형성되어 있으며, 이는 알고리즘 태도와 어떠한 관계가 있는지 살펴보았다. 이를 위해 전국 단위의 할당표집을 통해 성인 알고리즘 이용자 1,169명을 대상으로 설문을 시행하였다. 연구 결과, 첫째, 지식격차 요인 중 연령, 소득, 교육수준, 온라인미디어 이용, 디지털 리터러시에 따라 추천 알고리즘 지식에 유의미한 차이가 발견되었다. 즉, 연령이 낮고, 소득이 높으며, 온라인미디어 이용과 디지털 리터러시 수준이 높은 집단일수록 인지된 알고리즘 지식과 실제 알고리즘 지식이 모두 높은 경향을 보였다. 둘째, 알고리즘에 대한 인지된 지식과 실제 지식은 서로 정의 관계를 보였다. 그러나, 이들이 각각 알고리즘 태도에 미치는 영향은 상이했다. 인지된 지식만이 엔터테인먼트 추천 알고리즘 태도와 정적인 관계를 보였으며, 실제 지식은 어떤 종류의 알고리즘 태도와도 유의미한 관계를 보이지 않았다. 셋째, 지식 요인 외에 지식격차 요인 또한 알고리즘 태도에 유의미한 영향을 보였다. 구체적으로, 엔터테인먼트 콘텐츠 추천 알고리즘 태도에는 연령, 온라인미디어 이용, 디지털 리터러시가 각각 유의미한 관계를 보였으며, 뉴스 추천 알고리즘 태도에는 전통미디어와 온라인미디어 이용이 정적인 관계를 보였다. 반면, 광고 추천 알고리즘 태도에 영향을 미치는 지식격차 요인은 발견되지 않았다. 넷째, 세 종류의 추천 알고리즘 태도에 있어 공통적으로 높은 영향력을 보인 요인은 전통미디어 이용, 온라인미디어 이용, 디지털 리터러시였던 반면, 알고리즘 지식(인지된 지식 및 실제 지식)은 낮은 순위의 중요도를 차지했다. 이를 종합하면, 추천 알고리즘 태도 형성에 있어 미디어 이용과 디지털 리터러시가 가장 중요하였으며, 추천 알고리즘을 얼마만큼 이해하고 있는가에 대한 지식의 영향은 상대적으로 미미하다고 볼 수 있다. 또한, 추천 알고리즘 지식과 관련하여 연령, 소득, 교육수준, 디지털 리터러시 등의 요인에 의한 지식격차가 존재하였으나, 동일한 요인에 의한 격차가 알고리즘 태도에도 그대로 작용한다고 보기는 어려웠다. 추천 알고리즘 리터러시 교육과 관련한 함의를 논의하였다.
Abstract
Recommendation algorithms, while not immediately evident, can have a significant and lasting impact on users. Therefore, it is critical that media users recognize and comprehend these algorithms. Specifically, it is essential to accurately identify the potential negative outcomes and biases that recommendation algorithms may introduce, and to apply them with critical awareness. Such critical attitude is fundamental for the democratic use of recommendation algorithms. Hence, this study conducted an empirical analysis of the factors that shape people's attitudes toward recommendation algorithms. Specifically, we examined how perceived and actual knowledge about recommendation algorithms influence attitudes toward three types of recommendation algorithms—that are, entertainment content, news, and advertisements recommendation algorithms. We first investigated how two types of algorithm knowledge are influenced by (a) socio-demographic factors, (b) media use, and (c) digital literacy (collectively referred to as the "knowledge gap" factor), and examined how algorithm knowledge is associated with algorithm attitudes. A nation-wide survey of 1,169 adult algorithm users was conducted using quota sampling. The findings show that there were substantial disparities in levels of algorithm knowledge based on the knowledge gap factors such as age, income, education level, online media use, and digital literacy. Groups with younger individuals and those with higher levels of income, education, online media use, and digital literacy tend to have both higher perceived, and actual knowledge of recommendation algorithms. Second, perceived knowledge about recommendation algorithms had a positive relationship with actual knowledge. However, these two types of knowledge had different relationships with algorithm attitudes; that is, only perceived knowledge showed a positive relationship with entertainment-content algorithm, whereas actual knowledge did not show any significant relationship with any types of algorithm attitude. Third, there were several knowledge gap factors that significantly correlated with algorithm attitude. Age, online media use, and digital literacy were significantly related to attitudes toward entertainment-content recommendation algorithms, whereas traditional and online media use were positively related to news recommendation algorithm attitudes. On the other hand, no factors were found to influence attitudes toward advertisements recommendation algorithms. Fourth, across all three types of algorithms, traditional media use, online media use, and digital literacy were found to be significant factors influencing algorithm attitudes, while algorithm knowledge (both perceived and actual) was of lower importance. Overall, media use and digital literacy were the most critical factors in shaping attitudes toward recommendation algorithms, whereas algorithm knowledge had a minimal impact. Additionally, we found a "knowledge gap" in algorithm knowledge, in which people's level of algorithm knowledge varies significantly depending on their age, income, education level, and digital literacy. However, no identical pattern of gap was found in relation to the formation of algorithm attitudes. Implications for algorithm literacy education were discussed.
Keywords:
Recommendation Algorithm Attitude, Recommendation Algorithm Knowledge, Knowledge Gap Factors, Digital Divide키워드:
추천 알고리즘 태도, 추천 알고리즘 지식, 지식격차 요인, 디지털(정보)격차Acknowledgments
This work was supported by Pusan National University Research Grant, 2021(본 연구는 2021학년도 부산대학교 교내학술연구비(신임교수연구정착금)에 의한 연구임).
References
- Adekoya, H. O. (2013). Schema theory: A conceptual review. Journal of Research and Development, 1(2), 1-7.
- Alam, A., Cho, N., & Kim, K. (2018). The role of news media literacy in predicting news personalization and news engagement. Ewha Journal of Social Sciences, 34(1), 73-109. [https://doi.org/10.16935/ejss.2018.34.1.004]
- Albarracín, D., & Wyer, R. S., Jr. (2000). The cognitive impact of past behavior: Influences on beliefs, attitudes, and future behavioral decisions. Journal of Personality and Social Psychology, 79(1), 5-22. [https://doi.org/10.1037/0022-3514.79.1.5]
- Bandura, A. (2001). Social cognitive theory of mass communication. Media Psychology, 3(3), 265-299. [https://doi.org/10.1207/S1532785XMEP0303_03]
- Barnidge, M. (2021). Incidental exposure and news engagement: Testing temporal order and the role of political Interest. Digital Journalism, 11(1), 125-143. [https://doi.org/10.1080/21670811.2021.1906290]
- Beaudoin, M., & Desrichard, O. (2011). Are memory self-efficacy and memory performance related? A meta-analysis. Psychological Bulletin, 137(2), 211-241. [https://doi.org/10.1037/a0022106]
- Berger, C. R., & Calabrese, R. J. (1975). Some explorations in initial interaction and beyond: Toward a developmental theory of interpersonal communication. Human Communication Research, 1(2), 99-112. [https://doi.org/10.1111/j.1468-2958.1975.tb00258.x]
- Bodenhausen, G. V., & Gawronski, B. (2013). Attitude change. In D. Reisberg (Ed.), The Oxford handbook of cognitive psychology (pp. 957-969). New York, NY: Oxford University Press. [https://doi.org/10.1093/oxfordhb/9780195376746.013.0060]
- Campbell, S. W., Zhao, F., Frith, J., & Liang, F. (2021). Imagining 5G: Public sensemaking through advertising in China and the US. Mobile Media & Communication, 9(3), 546-562. [https://doi.org/10.1177/2050157920985239]
- Carlson, J. P., Vincent, L. H., Hardesty, D. M., & Bearden, W. O. (2009). Objective and subjective knowledge relationships: A quantitative analysis of consumer research findings. Journal of Consumer Research, 35(5), 864-876, [https://doi.org/10.1086/593688]
- Carpini, M. X. D., & Keeter, S. (1993). Measuring political knowledge: Putting first things first. American Journal of Political Science, 37(4), 1179-1206. [https://doi.org/10.2307/2111549]
- Chi, M. T. H., Glaser, R., & Rees, E. (1982). Expertise in problem solving. In R. J. Sternberg (Ed.), Advances in the psychology of human intelligence (Vol. 1). Hillsdale, NJ: Erlbaum.
-
Choi, I., Yum, J., Kim, R., & Jeong, S. (2018). Effects of income, age, and need for cognition on digital media skills and new media literacy. Journal of Cybercommunication Academic Society, 35(2), 181-221.
[
https://doi.org/10.36494/JCAS.2018.06.35.2.181
]
최인호·염정윤·김류원·정세훈 (2018). 소득, 연령, 인지욕구가 뉴미디어 리터러시에 미치는 영향과 연령과 인지욕구의 조절효과. <사이버커뮤니케이션학보>, 35권 2호, 181-221. -
Choi, J., Oh, H., & Jeon, H. (2023). Those who really know and those who look like they do: The effects of passive news consumption on subjective and objective political knowledge and political participation. Korean Journal of Broadcasting and Telecommunication Studies, 37(4), 310-333.
[
https://doi.org/10.22876/kab.2023.37.4.009
]
최지향·오해정·전현지 (2023). 정말 아는 시민과 아는 것 같은 시민: 수동적 뉴스 소비가 주관적, 객관적 정치지식 및 정치참여에 미치는 영향. <한국방송학보>, 37권 4호, 310-333. - Cotter, K., & Reisdorf, B. C. (2020). Algorithmic knowledge gaps: A new dimension of (digital) inequality. International Journal of Communication, 14, 745-765.
- Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319-340. [https://doi.org/10.2307/249008]
- de Vreese, C. H., & Boomgaarden, H. (2006). News, political knowledge and participation: The differential effects of news media exposure on political knowledge and participation. Acta Politica, 41, 317-341. [https://doi.org/10.1057/palgrave.ap.5500164]
- Diehl, T., & Lee, S. (2022). Testing the cognitive involvement hypothesis on social media: News-finds-me perceptions, partisanship, and fake news credibility. Computers in Human Behavior, 128, 107121. [https://doi.org/10.1016/j.chb.2021.107121]
- Dunlosky, J., & Metcalfe, J. (2009). Metacognition. Thousand Oaks, CA: Sage.
- Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003). Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3), 83-87. [https://doi.org/10.1111/1467-8721.01235]
- Eveland, W. P. (2001). The cognitive mediation model of learning from the news evidence from nonelection, off-year election, and presidential election contexts. Communication Research, 28(5), 571-601. [https://doi.org/10.1177/009365001028005001]
- Gerdon, F., Bach, R. L., Kern, C., & Kreuter, F. (2022). Social impacts of algorithmic decision-making: A research agenda for the social sciences. Big Data & Society, 9(1). [https://doi.org/10.1177/20539517221089305]
- Gil de Zúñiga, H., Cheng, Z., & González-González, P. (2022). Effects of the News-finds-me perception on algorithmic news attitudes and social media political homophily. Journal of Communication, 72(5), 578-591. [https://doi.org/10.1093/joc/jqac025]
- Gillespie, T. (2013). The relevance of algorithms. In T. Gillespie, P. Boczkowski, & K. Foot (Eds.), Media technologies: Essays on communication, materiality, and society (pp. 167-194). Cambridge, MA: MIT Press. [https://doi.org/10.7551/mitpress/9780262525374.003.0009]
- Gran, A., Booth, P., & Bucher, T. (2021). To be or not to be algorithm aware: A question of a new digital divide?. Information, Communication & Society, 24(12), 1779-1796. [https://doi.org/10.1080/1369118X.2020.1736124]
- Hargittai, E., & Hinnant, A. (2008). Digital inequality: Differences in young adults’ use of the Internet. Communication Research, 35(5), 602-621. [https://doi.org/10.1177/0093650208321782]
-
Heo, Y. (2020). Influence of news literacy on the perceived impact and regulatory attitude of fake News: Definition of fake news as moderator. Korean Journal of Communication & Information, 101, 506-534.
[
https://doi.org/10.46407/kjci.2020.06.101.506
]
허윤철 (2020). 뉴스 리터러시가 가짜뉴스의 영향력 지각과 규제 태도에 미치는 영향: 가짜뉴스 범위 인식의 조절 효과. <한국언론정보학보>, 통권 101호, 506-534. - Issar, S. (2023). The social construction of algorithms in everyday life: Examining tiktok users’ understanding of the platform’s algorithm. International Journal of Human-Computer Interaction. Advance online publication. [https://doi.org/10.1080/10447318.2023.2233138]
-
Jung, Y., & Lee, H. (2010). A time series analysis of the multi-dimensional information divide and its factors. Journal of Cybercommunication Academic Society, 27(3), 227-263.
정영호·이혜미 (2010). 다면적 정보 격차의 변화와 그 요인: 2005년~2009년 시계열 분석을 중심으로. <사이버커뮤니케이션학보>, 27권 3호, 227-263. -
Kim, H., & Lee, J. (2020). Ignoring political ignorance: Effects of actual political knowledge and perceived political knowledge on political participation. Korean Journal of Journalism & Communication Studies, 64(4), 210-246.
[
https://doi.org/10.20879/kjjcs.2020.64.4.006
]
김현우·이종혁 (2020). 정치적 무지에 대한 무지: 실제지식과 인지된 지식이 정치 참여에 미치는 효과 분석. <한국언론학보>, 64권 4호, 201-246. -
Kim, M. (2020). Digital divide in the age of artificial intelligence. Korean Regional Sociology, 21(1), 59-88.
[
https://doi.org/10.35175/KRS.2020.21.1.59
]
김문조 (2020). AI 시대의 디지털 격차. <지역사회학>, 21권 1호, 59-88. -
Kim, M., & Kim, J. (2002). Digital divide: Conceptual and practical implications. Korean Journal of Sociology, 36(4), 123-155.
김문조·김종길 (2002). 정보격차(Digital Divide)의 이론적·정책적 재고. <한국사회학>, 26권 4호, 123-155. -
Kim, M., & Lee, E. (2019). Digital news algorithm platform’s news reliability and false consensus effect: An analysis of the influence of motivation, perceived usefulness, perceived risk and perceived bias. Journal of Political Communication, 55, 39-83.
김미경·이은지 (2019). 디지털 뉴스 알고리즘 플랫폼의 뉴스 신뢰도와 합의착각 효과: 이용 동기, 지각된 유용성, 지각된 위험성과 지각된 편향성의 영향. <정치커뮤니케이션연구>, 통권 55호, 39-83. - Kim, S. (2008). Testing the knowledge gap hypothesis in South Korea: Traditional news media, the Internet, and political learning. International Journal of Public Opinion Research, 20(2), 193-210. [https://doi.org/10.1093/ijpor/edn019]
- Klin, C. M., Guzmán, A. E., & Levine, W. H. (1997). Knowing that you don't know: Metamemory and discourse processing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 23(6), 1378-1393. [https://doi.org/10.1037//0278-7393.23.6.1378]
- Knobloch, L. K., Satterlee, K. L., & DiDomenico, S. M. (2010). Relational uncertainty predicting appraisals of face threat in courtship: Integrating uncertainty reduction theory and politeness theory. Communication Research, 37(3), 303-334. [https://doi.org/10.1177/0093650210362527]
- Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121-1134. [https://doi.org/10.1037/0022-3514.77.6.1121]
- Kwak, N. (1999). Revisiting the knowledge gap hypothesis: Education, motivation, and media use. Communication Research, 26(4), 385-413. [https://doi.org/10.1177/009365099026004002]
- Lee, C. (2009). The role of Internet engagement in the health knowledge gap. Journal of Broadcasting & Electronic Media, 53(3), 365-382. [https://doi.org/10.1080/08838150903102758]
-
Lee, M. (2020). A study on the influence of digital divide on knowledge gap in intelligent information society. Social Science Research Review, 36(2), 119-143.
[
https://doi.org/10.18859/ssrr.2020.5.36.2.119
]
이민상 (2020). 디지털격차의 지식격차에 대한 영향 연구: 지능정보사회에 대한 지식격차를 중심으로. <사회과학연구>, 36권 2호, 119-143. -
Lee, S., & Kang, S. (2024). User understanding and perceptions of news recommendation algorithms: Relationships with attitude-consistent news exposure, news trust, and news-seeking behavior. Korean Journal of Journalism & Communication Studies, 68(1), 348-385.
[
https://doi.org/10.20879/kjjcs.2024.68.1.010
]
이슬기·강신후 (2024). 맞춤화 정보 환경에서 뉴스 추천 알고리즘에 대한 이용자 이해도와 인식의 중요성 관점 일치 뉴스 노출, 뉴스 신뢰, 뉴스 추구 행위와의 관계를 중심으로. <한국언론학보>, 68권 1호, 348-385. -
Lee, S., & Son, Y. (2018). Coorientational analysis among media literacy practitioners - literacy experienced persons - literacy nonexperienced persons. Journal of Communication Research, 55(2), 213-257.
[
https://doi.org/10.22174/jcr.2018.55.2.213
]
이수범·손영곤 (2018). 미디어 리터러시에 대한 기획자, 경험자, 비경험자간 인식 차이: 상호지향성 모델을 중심으로. <언론정보연구>, 55권 2호, 213-257. -
Lee, S., & Youk, E. (2014). Digital capability divide and digital outcome divide: Gaps in the digital capability and its effects on informational support. Korean Journal of Journalism & Communication Studies, 58(5), 206-232.
이숙정·육은희 (2014). 디지털 활용 격차와 결과 격차: 디지털 활용 능력과 정보적 지지를 중심으로. <한국언론학보>, 58권 5호. 206-232. - Mao, C. M., & Hovick, S. R. (2022). Adding affordances and communication efficacy to the technology acceptance model to study the messaging features of online patient portals among young adults. Health Communication, 37(3), 307-315. [https://doi.org/10.1080/10410236.2020.1838106]
- McVee, M. B., Dunsmore, K., & Gavelek, J. R. (2005). Schema theory revisited. Review of Educational Research, 75(4), 531-566. [https://doi.org/10.3102/00346543075004531]
- Míguez-Álvarez, C., Cuevas-Alonso, M., & Cruz, M. (2021). The relationship between metacomprehension and reading comprehension in spanish as a second language. Psicología Educativa, 28(1), 23-29. [https://doi.org/10.5093/psed2021a26]
-
Min, Y. (2011). The digital divide among Internet users: An analysis of digital access, literacy, and participation. Journal of Communication Research, 48(1), 150-187.
[
https://doi.org/10.22174/jcr.2011.48.1.150
]
민영 (2011). 인터넷 이용과 정보격차: 접근, 활용, 참여를 중심으로. <언론정보연구>, 48권 1호, 150-187. - Nonaka, I. (1994). A dynamic theory of organizational knowledge creation. Organization Science, 5(1), 14-37. [https://doi.org/10.1287/orsc.5.1.14]
- Oeldorf-Hirsch, A., & Neubaum, G. (2023a). Attitudinal and behavioral correlates of algorithmic awareness among German and U.S. social media users. Journal of Computer-Mediated Communication, 28(5), 1-12. [https://doi.org/10.1093/jcmc/zmad035]
- Oeldorf-Hirsch, A., & Neubaum, G. (2023b). What do we know about algorithmic literacy? The status quo and a research agenda for a growing field. New Media & Society. [https://doi.org/10.1177/14614448231182662]
-
Oh, S. (2019). Mobile news use patterns since portals’ adoption of algorithm-based news arrangement. Media Issue, 5(4), 1-16.
오세욱 (2019). 포털 등의 알고리즘 배열 전환 이후 모바일 뉴스 이용 행태. <미디어이슈>, 5권 4호, 1-16. -
Oh, S., & Yoon, H. (2022). ‘Algorithm’ approached with ‘media literacy’: Focusing on the case of ‘NewsAlgo’. Korean Journal of Broadcasting & Telecommunications Research, 2022 Special Issue, 7-37.
오세욱·윤현옥 (2022). ‘미디어 리터러시’로 접근한 ‘알고리즘’: ‘뉴스알고(NewsAlgo)’ 사례를 중심으로. <방송통신연구>, 2022년 특집호, 7-37. - Pariser, E. (2011). The filter bubble: What the Internet is hiding from you. New York, NY: Penguin Press.
-
Song, H. (2014). Consideration to influence factor of using internet information and the second digital divide: Focus on users’ digital literacy, perceived awareness, and self-efficacy. Korean Policy Sciences Review, 18(2), 85-116.
송효진 (2014). 질적 정보격차와 인터넷 정보이용의 영향요인 고찰: 이용자의 디지털 리터러시, 인식, 자기효능감을 중심으로. <한국정책과학학회보>, 18권 2호, 85-116. - Tichenor, P. J., Donohue, G. A., & Olien, C. N. (1970). Mass media flow and differential growth in knowledge. Public Opinion Quarterly, 34, 159-170. [https://doi.org/10.1086/267786]
- Van Duyn, E., & Collier, J. (2019). Priming and fake news: The effects of elite discourse on evaluations of news media. Mass Communication and Society, 22, 29–48. [https://doi.org/10.1080/15205436.2018.1511807]
- Velasquez, A., & Rojas, H. (2017). Political expression on social media: The role of communication competence and expected outcomes. Social Media + Society, 3(1). [https://doi.org/10.1177/2056305117696521]
- Vraga, E. K., Tully, M., Maksl, A., Craft, S., & Ashley, S. (2021). Theorizing news literacy behaviors. Communication Theory, 31(1), 1-21. [https://doi.org/10.1093/ct/qtaa005]
- Wei, L., & Hindman, D. B. (2011). Does the digital divide matter more? Comparing the effects of new media and old media use on the education-based knowledge gap. Mass Communication and Society, 14(2), 216-235. [https://doi.org/10.1080/15205431003642707]
- Weinstein, J. (2017). Hate speech bans, democracy, and political legitimacy. Constitutional Comment, 32, 619-629.
- Williams, B. A., Brooks, C. F., & Shmargad, Y. (2018). How algorithms discriminate based on data they lack: Challenges, solutions, and policy implications. Journal of Information Policy, 8, 78-115. [https://doi.org/10.5325/jinfopoli.8.2018.0078]
- Wilson, K. R., Wallin, J. S., & Reiser, C. (2003). Social stratification and the digital divide. Social Science Computer Review, 21(2), 133-143. [https://doi.org/10.1177/0894439303021002001]
- Yamamoto, M., & Yang, F. (2022). Does news help us become knowledgeable or think we are knowledgeable? Examining a linkage of traditional and social media use with political knowledge. Journal of Information Technology & Politics, 19(3), 269-283. [https://doi.org/10.1080/19331681.2021.1969611]
-
Yeom, J., & Jung, S. (2018). Research on fake news perception and fact-checking effect: Role of prior-belief consistency. Korean Journal of Journalism & Communication Studies, 62(2), 41-80.
[
https://doi.org/10.20879/kjjcs.2018.62.2.002
]
염정윤·정세훈 (2018). 가짜뉴스에 대한 인식과 팩트체크 효과 연구: 기존 신념과의 일치 여부를 중심으로. <한국언론학보>, 62권 2호, 41-80. - Ytre-Arne, B., & Moe, H. (2021). Folk theories of algorithms: Understanding digital irritation. Media, Culture & Society, 43(5), 807-824. [https://doi.org/10.1177/0163443720972314]
- Zarouali, B., Boerman, S. C., & de Vreese, C. H. (2021). Is this recommended by an algorithm? The development and validation of the algorithmic media content awareness scale (AMCA-scale). Telematics and Informatics, 62, 101607. [https://doi.org/10.1016/j.tele.2021.101607]
- Zou, J., & Schiebinger, L. (2018). AI can be sexist and racist - It's time to make it fair. Nature, 559(7714), 324-326. [https://doi.org/10.1038/d41586-018-05707-8]