Best Practices in Data Collection and Instrument Development: An Applicative Guide for Quantitative Researchers
DOI:
https://doi.org/10.61166/interdisiplin.v3i2.150Keywords:
data collection techniques, research instruments, quantitative research, validity, reliabilityAbstract
Quantitative research requires appropriate data collection techniques and quality research instruments to produce valid and reliable findings. The purpose of this study is to describe various data collection techniques in quantitative research along with the systematic process of developing research instruments that meet psychometric standards. This research uses a literature review method by comprehensively analyzing research methodology literature from various credible academic sources, including research methodology textbooks and indexed scientific journal articles. Data analysis was conducted using content analysis methods with a thematic approach to identify main themes related to data collection techniques and the development of quantitative research instruments. The research results show that quantitative data collection techniques include surveys, experiments, structured observations, and the use of secondary data, where the selection of appropriate techniques must be adjusted to population characteristics, types of information needed, and available resources. Quality research instruments must meet validity criteria that ensure the instrument measures the intended construct and reliability that guarantees measurement consistency. The instrument development process involves systematic stages from conceptual and operational definition of variables, clear item writing, content validation by experts, instrument testing, to psychometric analysis using appropriate statistical techniques. Contemporary challenges in quantitative research include adaptation to digital transformation through online surveys, utilization of big data, handling declining response rates, and ethical considerations regarding privacy and informed consent. This research concludes that the integration of methodological rigor, technological innovation, and ethical sensitivity is key to producing quantitative research that is not only technically valid and reliable, but also socially responsible and capable of making meaningful contributions to the development of knowledge and evidence-based decision making.
References
Babbie, E. R. (2020). The practice of social research (15th ed.). Boston: Cengage Learning.
Barocas, S., & Selbst, A. D. (2016). Big data’s disparate impact. California Law Review, 104, 671–732.
Biemer, P. P., & Lyberg, L. E. (2003). Introduction to survey quality. Hoboken: John Wiley & Sons.
Bryman, A. (2016). Social research methods (5th ed.). Oxford: Oxford University Press.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale: Lawrence Erlbaum Associates.
Collaboration, O. S. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), 4716.
Couper, M. P. (2000). Web surveys: A review of issues and approaches. Public Opinion Quarterly, 64(4), 464–494.
Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Thousand Oaks: SAGE Publications.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334.
Denzin, N. K., & Lincoln, Y. S. (2018). The SAGE handbook of qualitative research (5th ed.). Thousand Oaks: SAGE Publications.
DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (4th ed.). Thousand Oaks: SAGE Publications.
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method (4th ed.). Hoboken: Wiley.
Duchowski, A. T. (2017). Eye tracking methodology: Theory and practice. Springer.
Fowler, F. J. (2014). Survey research methods. Thousand Oaks: SAGE Publications.
Greenland, S., et al. (2016). Statistical tests, P values, confidence intervals, and power: A guide to misinterpretations. European Journal of Epidemiology, 31(4), 337–350.
Kaplan, D. (2004). The SAGE handbook of quantitative methodology for the social sciences. Thousand Oaks: SAGE Publications.
Kitchin, R. (2014). The data revolution: Big data, open data, data infrastructures and their consequences. London: SAGE Publications.
Kline, R. B. (2023). Principles and practice of structural equation modeling. New York: Guilford Publications.
Kozinets, R. V. (2010). Netnography: Doing ethnographic research online. London: SAGE Publications.
Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 22(140), 1–55.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749.
Nosek, B. A., Spies, J. R., & Motyl, M. (2012). Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspectives on Psychological Science, 7(6), 615–631.
Revilla, M., & Ochoa, C. (2017). Ideal and maximum length for a web survey. International Journal of Market Research, 59(5), 557–565.
Ruane, J. M. (2005). Essentials of research methods. Malden, MA: Blackwell Publishing.
Salganik, M. J. (2019). Bit by bit: Social research in the digital age. Princeton, NJ: Princeton University Press.
Schulz, K. F., Altman, D. G., & Moher, D. (2010). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. BMC Medicine, 8(1), 18.
Tourangeau, R., Conrad, F. G., & Couper, M. P. (2013). The science of web surveys. Oxford: Oxford University Press.
Zikmund, W. G., et al. (2013). Business research methods (9th ed.). Boston: Cengage Learning.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Ahmad Abdullah Faqih, Nashrullah Nashrullah
This work is licensed under a Creative Commons Attribution 4.0 International License.
