The Cost of Primary Care Research

Article Type
Changed
Mon, 01/14/2019 - 11:13
Display Headline
The Cost of Primary Care Research

A significant portion of research project costs is incurred before the receipt of grant funds. This poses a problem for the initiation of primary care research, especially in community practice settings. Potential investigators need financial support for staff time, training, pilot work, and grant proposal writing if primary care researchers are to compete successfully for grant funds. To find this support, we need to understand and eventually quantify the actual costs of research with attention to those that are incurred before the receipt of grant funds.

We outline 10 phases of the research process and provide a model for understanding where costs are incurred and by whom. Costs include those associated with maintaining practice interest in research, supporting practice participation, and disseminating research findings. They may be incurred by either an academic center or a research network, by the practices and physicians themselves, or by an extramural funding source.

The needed investment for initiating primary care research can be itemized and, with further research, quantified. This will enhance the arguments for capital investments in the primary care research enterprise.

The need for a strong research base for primary care has been generally acknowledged in the United States and elsewhere for nearly 30 years.1-5 Still, family physicians and other primary care physicians are not doing well in the competition for National Institutes of Health (NIH) funding6; this situation has changed little in more than a decade.7 Although it has been argued that the amount of NIH funding is proportional to the burden of disease,8 these analyses have not considered the potential impact of federal funding on disease burden if it were more available for research in different settings, such as those of community primary care. For example, the burden of liver disease may be reduced more by primary care research directed to helping physicians treat patients who drink too much9 than by research on liver transplantation.

A significant portion of research project costs is incurred before the receipt of grant funds. This poses a major problem for the development of a primary care research enterprise. Researchers, especially new ones, require financial support for investigator and staff time, training, pilot work, and grant proposal writing to compete successfully for grant funds. Although some institutional funding is available in academic medical centers to support the initiation of research, there is little or no comparable resource in community practices. These “laboratories” for most practice-based primary care research must find ways to integrate research activities with direct patient care needs, and a culture of support for inquiry needs to be developed and sustained along with a supporting infrastructure.

Start-up support is being reduced even within academic medical centers, and this support is especially critical for young faculty and for pilot work.10,11 The negative impact of this, while significant for all research,12 may be even more problematic for the nascent field of primary care research, which relies disproportionately on internal resources,13 and especially for practice-based research, since community physicians generally lack institutional resources. Furthermore, the critical importance of primary care clinical services to academic medical centers, with the resulting demands on faculty, can detract from allocation of time and money to research activities.14 To add to the problem of initiating research in primary care, there is evidence of a bias against patient-oriented research compared with that which is laboratory oriented, making obtaining grant funds for clinical researchers even more difficult and time consuming.15

Although the NIH has proposed solutions for increasing the number of physicians engaged in clinical research,16 the problem of developing researchers capable of maintaining research funding cycles in the primary care specialties has not been adequately addressed at the national level. Although concerned with clinical research, the NIH has not made primary care research a priority. Even programs that attempt to develop primary care researchers fail to take into account associated costs.17

In part, primary care’s disappointing research productivity has been due to a lack of the capital investment needed to develop robust research infrastructures (which include practice-based laboratories) and the limited availability of the financial and institutional support that investigators need to apply for project funding. This lack of an adequate infrastructure and sufficient funding to invest in the start-up process before the receipt of grant funding has proved to be a nearly insurmountable barrier to potential primary care investigators. It has been less a barrier to faculty in other disciplines in which long histories of grant-funded projects have enabled them to use resources from previously funded projects as the start-up capital for future ones. Although mechanisms are in place in some primary care departments for a capital investment of funds and for protected time and mentoring, these resources are generally limited and are threatened. A further problem exists in that even with start-up funding it may be difficult, if not impossible, to sustain a research program with a limited number of grant-funded projects running at any one time.18

 

 

Despite its critical role in the development of a research enterprise, the requirement for support for start-up efforts has not been quantified, and no scheme for such quantification has been published. Appropriately, grant budgets do not include the costs of getting to the point of grant submission. However, costs are incurred that must be covered by some source.

We provide a model that lists categories that will allow for the quantification of primary care research costs, including those incurred before the receipt of grant funds (Figure). In this model we assume that a significant portion of primary care research will be practice based, and thus we have included in our model costs related to the practices. One way of developing and using a “laboratory” for practice-based research is through the development and use of a practice-based research network, and thus these costs are also reflected in our model. We acknowledge that many aspects of the model would also apply to research in other settings, including basic science research and traditional clinical research in academic settings.

Methods

To develop our model, a group of University of Wisconsin and Wisconsin Research Network investigators experienced in primary care research explored the activities and associated costs necessary for conducting research projects. This group included an academic family physician (J.W.B.), a community family physician (D.H.), and 3 experienced research staff members (P.W., M.B.P., L.M.). We began with 4 core assumptions and then identified 10 phases of activity in the research process, the first 4 of which occur before the receipt of grant funding.

Four Assumptions

On the basis of our collective experience, our group made 4 assumptions that are important for our analysis of the costs associated with primary care research. These assumptions are:

  1. Expensive phases of the research process occur before the receipt of grant funds. It is therefore difficult to initiate major research solely through the grant-funding process. Many activities related to developing hypotheses, determining research methods, doing pilot work, and producing fundable proposals must occur before grant funding. Based on our collective experiences in applying for federal funding, we estimate that an investigator requires approximately a year of full-time equivalent work (eg, 25% time over 4 years) to get his or her first R01 grant funding.19-21 An unsuccessful application by one skilled individual was estimated to cost 220 hours of effort, exclusive of the time of staff and colleagues.22
  2. We need community practice settings for primary care research, and their research activities should be rewarded at approximately the same rate as other practice activities. Not only are these settings critical when physician practice is the object of the research, but it also seems that patient recruitment may be better (possibly with less selection bias) in community practices,23 since more patients are served by these than academic practices. Physicians and patients in community practice settings cannot participate without remuneration, especially when many studies and more time-consuming and sophisticated interventional studies are done. This is not only an issue of physician volunteerism. More physicians and staff are members of corporate medical entities that are beginning to insist on reimbursement for every corporate activity. Generally, pharmaceutical research is the only research that has budgeted adequate reimbursement for practices.
  3. Patients must not incur costs for participating in research activities. Making patients financially support research will reduce participation and potentially increase selection bias.
  4. An exact calculation for the budgeting of research activities across various primary care settings is not possible, since expenses are organization- and project-dependent. However, general estimates could be fit into the model.

The Research Process Before the Receipt of Grant Funding

The costs of research in primary care can be classified into 10 phases of operation by the series of tasks that have to be accomplished and by the organizations that will be required to accomplish them. Although our list may not exhaust the possible range of phases and organizations, it can serve as a framework for discussion of the resources needed to conceptualize a project, apply for funding, and carry out research. Not all phases are applicable to all projects, but in general most research will require activity in most phases.

  • Phase 1: Develop and Maintain a Commitment to Research. Regardless of whether a formal research network is used, researchers must convince the practice community to support research efforts, especially since projects that originate within academic departments may be removed from the interests and concerns of physicians in community practice. If a research network is involved as a means to maintain the “laboratory,” an ongoing investment in network operations is required. We note that even ongoing successful research institutions generally cannot rely solely on grant funding.24 These institutions often have some base support from other sources, such as state funding.
  • Phase 2: Conceptualize and Design a Project. Time and energy must be invested in literature reviews, conferences, and consultations to design a research project that builds on existing experience and knowledge. The active involvement of clinicians at this stage helps to ensure buy-in and, more important, ensures that the results of the research are likely to be relevant to practice.
  • Phase 3: Pilot-Test and Revise the Design. Generally, it is necessary to conduct some preliminary research to demonstrate feasibility and work out methodologic details before writing the grant proposal. Data collection instruments may have to be identified or developed, and some statistical analysis should be done.
  • Phase 4: Write and Submit the Grant Proposal. Preparing a grant proposal requires time for writing, obtaining institutional review board approval, realistic budgeting, consultation, and revision. These efforts may not achieve the desired goal of funding, however; only 20% of NIH submissions receive funding on the first submission.
 

 

The Research Process After the Receipt of Grant Funding

  • Phase 5: Recruit the Practice Sites, Clinicians, and Patients. The larger, more complex, and more intrusive the research project, the more difficult this stage of operation is. The expenses of this phase have recently been described25-27 and quantified.28
  • Phase 6: Train the Researchers, Clinicians, and Staff. It may prove necessary to provide training for the personnel involved in the project. They may include research project staff, clinicians, and clinical staff at multiple or remote sites.
  • Phase 7: Collect the Data. Data need to be collected at several steps along the way. If the trial is an interventional trial, pre- and postintervention data will be needed. Other types of research will require the tracking of patients over time. Data about physician-patient interactions may be difficult to collect, often requiring intensive qualitative methods.
  • Phase 8: Intervention. Conducting the intervention will require clinician and patient time, staff time, materials, travel, and communication costs.
  • Phase 9: Data Entry and Analysis. Database design and management and data entry are required. Data analysis is needed.
  • Phase 10: Disseminate Results. The dissemination of study results must include feedback to practices, the preparation of grant reports, publication, and presentations. In addition, primary care research projects should include arrangements for the translation of the research results into practice.

The costs related to each phase of operation must be funded (directly or indirectly) by one or more of 3 sources: (1) the academic or network infrastructure; (2) the practice site infrastructure, including the physician and patient; and (3) an extramural funding source.

The proportion of costs incurred by the various organizations or the extramural funding source will vary over time for any project. There is considerable overlap in how the costs of the various phases of research are distributed among the 3 types of sources. However, any extramural funding source will help support the research costs only in phase 5 and beyond.

Discussion

We have outlined the phases of research in a way that allows for some itemization of project expenses. The importance of the development and maintenance of a robust and well-funded support infrastructure is demonstrated by the fact that all activities up to and including those in phase 4 are performed before receiving grant funding.

Limitations

The limitations of this work include the lack of external validation of our model. Nonetheless, the basic outline provides one way to look at the costs of initiating and conducting research projects. We encourage other researchers to build on these ideas. In future work we intend to attach costs to the phases and activities outlined in this paper.

Conclusions

We hope that we have articulated the need for capital investment in the primary care research process, with special attention to practice-based research. This investment, which has paid great dividends in other areas of medicine, will help primary care investigators meet the challenge of developing a robust research enterprise. Such an investment will help us to ensure that the questions asked are important ones for primary care clinicians and that the answers will ultimately pay dividends in the health of our population in the same way research in other areas of medicine has.

References

1. White KL, Williams TL, Greenberg BG. The ecology of medical care. N Engl J Med 1961;265:885-92.

2. Lanier D, Clancy C. Primary care research: current challenges, future needs. J Fam Pract 1997;44:434-38.

3. Donaldson MS, Yordy KD, Lorh KN, Vanselow NA, eds, Primary care: America’s health in a new era. Washington, DC: Institute of Medicine; 1996;216-46.

4. Nutting PA, Beasley JW, Werner JJ. Asking and answering questions in practice: practice-based research networks build the science base of family practice. JAMA 1999;281:686-88.

5. Culyer A. National Health Service. Research and Development Task Force. Supporting research and development in the NHS. London, England: Her Majesty’s Stationary Office; 1994.

6. Campos-Octcalt D, Senf J. Family medicine research funding. Fam Med 1999;31:709-12.

7. Culpepper L. Research funding for family medicine: dilemmas and options. Fam Med 1986;18:363-68.

8. Gross CP, Anderson GF, Powe NR. The relation between funding by the National Institutes of Health and the burden of disease. N Eng J Med 1999;340:1881-87.

9. Fleming MF, Barry KL, Manwell LB, Johnson MA, London R. Brief physician advice for problem alcohol drinkers: a randomized controlled trial in community-based primary care practices. JAMA 1997;277:1039-45.

10. Weissman JS, Saglam D, Campbell EG, Causino N, Blumenthal D. Market forces and unsponsored research in academic health centers. JAMA 1999;281:1093-98.

11. Campbell EG, Weissman JS, Blumenthal D. Relationship between market competition and the activities and attitudes of medical school faculty. JAMA 1997;278:222-26.

12. Moy E, Mazzaschi AJ, Levin RJ, Blake DA, Griner PF. Relationship between National Institutes of Health research awards to US medical schools and managed care market penetration. JAMA 1997;278:217-21.

13. Ruffin MT, Sheets KJ. Primary care research funding sources. J Fam Pract 1992;35:281-87.

14. Weiss BD. The death of academic family medicine: can it be prevented? Fam Med 1995;27:139-42.

15. Williams GH, Wara DW, Carbone P. Funding for patient-oriented research: critical strain on a fundamental linchpin. JAMA 1997;287:227-32.

16. Nathan DG. The National Institutes of Health Director’s Panel on Clinical Research. Clinical research: perceptions, reality and proposed solutions. JAMA 1998;280:1427-31.

17. Curtis P, Shaffer VD, Goldstein AO, Seufert L. Counting the cost of an NRSA Primary Care Research Fellowship Program. Fam Med 1998;30:19-23.

18. Culpepper L. The internal environment: critical functions in conducting network research. In: Practice-based research networks in the 21st century: the pearls of research. Proceedings from the conference convened by the AAFP Task Force to Enhance Family Practice Research. Leawood, Kan: American Academy of Family Physicians; 1999.

19. McBride P. Personal communication; 1999.

20. Fleming M. Personal communication; 1999.

21. Brown RL. Personal communication; 1999.

22. Roberts R. Personal communication; 1999.

23. Kelly RB, McMahon SH, Hazey JA. Does practice location or academic connection affect recruitment of patients as research subjects? Fam Pract Res J 1992;12:177-84.

24. Association of American Medical Colleges. Maximizing the investment: principles to guide the federal-academic partnership in biomedical and health sciences research. Washington, DC: Association of American Medical Colleges; 1998.

25. Levinson W, Dull VT, Roter RL, Chaumeton N, Frankel RM. Recruiting physicians for office-based research. Med Care 1998;36:934-37.

26. Carey TS, Kinsinger L, Keyserling T, Harris R. Research in the community: recruiting and retaining practices. J Community Health 1996;21:315-27.

27. Borgiel AEM, Dunn EV, Lamont CT, et al. Recruiting family physicians as participants in research. Fam Pract 1989;6:168-72.

28. McBride P, Massoth KM, Underbakke G, Solberg LI, Beasley J, Plane MB. Recruitment of practices for primary care research: experiences in a preventive services clinical trial. J Fam Pract 1996;43:389-95.

Author and Disclosure Information

John W. Beasley, MD
David L. Hahn, MD, MS
Pamela Wiesen, MBA
Mary Beth Plane, MSSW, PhD
Linda Manwell
Madison, Wisconsin
jbeasley@fammed.wisc.edu.

Issue
The Journal of Family Practice - 49(11)
Publications
Page Number
985-989
Legacy Keywords
,Family practiceprimary health careresearchresearch support. (J Fam Pract 2000; 49:985-989)
Sections
Author and Disclosure Information

John W. Beasley, MD
David L. Hahn, MD, MS
Pamela Wiesen, MBA
Mary Beth Plane, MSSW, PhD
Linda Manwell
Madison, Wisconsin
jbeasley@fammed.wisc.edu.

Author and Disclosure Information

John W. Beasley, MD
David L. Hahn, MD, MS
Pamela Wiesen, MBA
Mary Beth Plane, MSSW, PhD
Linda Manwell
Madison, Wisconsin
jbeasley@fammed.wisc.edu.

A significant portion of research project costs is incurred before the receipt of grant funds. This poses a problem for the initiation of primary care research, especially in community practice settings. Potential investigators need financial support for staff time, training, pilot work, and grant proposal writing if primary care researchers are to compete successfully for grant funds. To find this support, we need to understand and eventually quantify the actual costs of research with attention to those that are incurred before the receipt of grant funds.

We outline 10 phases of the research process and provide a model for understanding where costs are incurred and by whom. Costs include those associated with maintaining practice interest in research, supporting practice participation, and disseminating research findings. They may be incurred by either an academic center or a research network, by the practices and physicians themselves, or by an extramural funding source.

The needed investment for initiating primary care research can be itemized and, with further research, quantified. This will enhance the arguments for capital investments in the primary care research enterprise.

The need for a strong research base for primary care has been generally acknowledged in the United States and elsewhere for nearly 30 years.1-5 Still, family physicians and other primary care physicians are not doing well in the competition for National Institutes of Health (NIH) funding6; this situation has changed little in more than a decade.7 Although it has been argued that the amount of NIH funding is proportional to the burden of disease,8 these analyses have not considered the potential impact of federal funding on disease burden if it were more available for research in different settings, such as those of community primary care. For example, the burden of liver disease may be reduced more by primary care research directed to helping physicians treat patients who drink too much9 than by research on liver transplantation.

A significant portion of research project costs is incurred before the receipt of grant funds. This poses a major problem for the development of a primary care research enterprise. Researchers, especially new ones, require financial support for investigator and staff time, training, pilot work, and grant proposal writing to compete successfully for grant funds. Although some institutional funding is available in academic medical centers to support the initiation of research, there is little or no comparable resource in community practices. These “laboratories” for most practice-based primary care research must find ways to integrate research activities with direct patient care needs, and a culture of support for inquiry needs to be developed and sustained along with a supporting infrastructure.

Start-up support is being reduced even within academic medical centers, and this support is especially critical for young faculty and for pilot work.10,11 The negative impact of this, while significant for all research,12 may be even more problematic for the nascent field of primary care research, which relies disproportionately on internal resources,13 and especially for practice-based research, since community physicians generally lack institutional resources. Furthermore, the critical importance of primary care clinical services to academic medical centers, with the resulting demands on faculty, can detract from allocation of time and money to research activities.14 To add to the problem of initiating research in primary care, there is evidence of a bias against patient-oriented research compared with that which is laboratory oriented, making obtaining grant funds for clinical researchers even more difficult and time consuming.15

Although the NIH has proposed solutions for increasing the number of physicians engaged in clinical research,16 the problem of developing researchers capable of maintaining research funding cycles in the primary care specialties has not been adequately addressed at the national level. Although concerned with clinical research, the NIH has not made primary care research a priority. Even programs that attempt to develop primary care researchers fail to take into account associated costs.17

In part, primary care’s disappointing research productivity has been due to a lack of the capital investment needed to develop robust research infrastructures (which include practice-based laboratories) and the limited availability of the financial and institutional support that investigators need to apply for project funding. This lack of an adequate infrastructure and sufficient funding to invest in the start-up process before the receipt of grant funding has proved to be a nearly insurmountable barrier to potential primary care investigators. It has been less a barrier to faculty in other disciplines in which long histories of grant-funded projects have enabled them to use resources from previously funded projects as the start-up capital for future ones. Although mechanisms are in place in some primary care departments for a capital investment of funds and for protected time and mentoring, these resources are generally limited and are threatened. A further problem exists in that even with start-up funding it may be difficult, if not impossible, to sustain a research program with a limited number of grant-funded projects running at any one time.18

 

 

Despite its critical role in the development of a research enterprise, the requirement for support for start-up efforts has not been quantified, and no scheme for such quantification has been published. Appropriately, grant budgets do not include the costs of getting to the point of grant submission. However, costs are incurred that must be covered by some source.

We provide a model that lists categories that will allow for the quantification of primary care research costs, including those incurred before the receipt of grant funds (Figure). In this model we assume that a significant portion of primary care research will be practice based, and thus we have included in our model costs related to the practices. One way of developing and using a “laboratory” for practice-based research is through the development and use of a practice-based research network, and thus these costs are also reflected in our model. We acknowledge that many aspects of the model would also apply to research in other settings, including basic science research and traditional clinical research in academic settings.

Methods

To develop our model, a group of University of Wisconsin and Wisconsin Research Network investigators experienced in primary care research explored the activities and associated costs necessary for conducting research projects. This group included an academic family physician (J.W.B.), a community family physician (D.H.), and 3 experienced research staff members (P.W., M.B.P., L.M.). We began with 4 core assumptions and then identified 10 phases of activity in the research process, the first 4 of which occur before the receipt of grant funding.

Four Assumptions

On the basis of our collective experience, our group made 4 assumptions that are important for our analysis of the costs associated with primary care research. These assumptions are:

  1. Expensive phases of the research process occur before the receipt of grant funds. It is therefore difficult to initiate major research solely through the grant-funding process. Many activities related to developing hypotheses, determining research methods, doing pilot work, and producing fundable proposals must occur before grant funding. Based on our collective experiences in applying for federal funding, we estimate that an investigator requires approximately a year of full-time equivalent work (eg, 25% time over 4 years) to get his or her first R01 grant funding.19-21 An unsuccessful application by one skilled individual was estimated to cost 220 hours of effort, exclusive of the time of staff and colleagues.22
  2. We need community practice settings for primary care research, and their research activities should be rewarded at approximately the same rate as other practice activities. Not only are these settings critical when physician practice is the object of the research, but it also seems that patient recruitment may be better (possibly with less selection bias) in community practices,23 since more patients are served by these than academic practices. Physicians and patients in community practice settings cannot participate without remuneration, especially when many studies and more time-consuming and sophisticated interventional studies are done. This is not only an issue of physician volunteerism. More physicians and staff are members of corporate medical entities that are beginning to insist on reimbursement for every corporate activity. Generally, pharmaceutical research is the only research that has budgeted adequate reimbursement for practices.
  3. Patients must not incur costs for participating in research activities. Making patients financially support research will reduce participation and potentially increase selection bias.
  4. An exact calculation for the budgeting of research activities across various primary care settings is not possible, since expenses are organization- and project-dependent. However, general estimates could be fit into the model.

The Research Process Before the Receipt of Grant Funding

The costs of research in primary care can be classified into 10 phases of operation by the series of tasks that have to be accomplished and by the organizations that will be required to accomplish them. Although our list may not exhaust the possible range of phases and organizations, it can serve as a framework for discussion of the resources needed to conceptualize a project, apply for funding, and carry out research. Not all phases are applicable to all projects, but in general most research will require activity in most phases.

  • Phase 1: Develop and Maintain a Commitment to Research. Regardless of whether a formal research network is used, researchers must convince the practice community to support research efforts, especially since projects that originate within academic departments may be removed from the interests and concerns of physicians in community practice. If a research network is involved as a means to maintain the “laboratory,” an ongoing investment in network operations is required. We note that even ongoing successful research institutions generally cannot rely solely on grant funding.24 These institutions often have some base support from other sources, such as state funding.
  • Phase 2: Conceptualize and Design a Project. Time and energy must be invested in literature reviews, conferences, and consultations to design a research project that builds on existing experience and knowledge. The active involvement of clinicians at this stage helps to ensure buy-in and, more important, ensures that the results of the research are likely to be relevant to practice.
  • Phase 3: Pilot-Test and Revise the Design. Generally, it is necessary to conduct some preliminary research to demonstrate feasibility and work out methodologic details before writing the grant proposal. Data collection instruments may have to be identified or developed, and some statistical analysis should be done.
  • Phase 4: Write and Submit the Grant Proposal. Preparing a grant proposal requires time for writing, obtaining institutional review board approval, realistic budgeting, consultation, and revision. These efforts may not achieve the desired goal of funding, however; only 20% of NIH submissions receive funding on the first submission.
 

 

The Research Process After the Receipt of Grant Funding

  • Phase 5: Recruit the Practice Sites, Clinicians, and Patients. The larger, more complex, and more intrusive the research project, the more difficult this stage of operation is. The expenses of this phase have recently been described25-27 and quantified.28
  • Phase 6: Train the Researchers, Clinicians, and Staff. It may prove necessary to provide training for the personnel involved in the project. They may include research project staff, clinicians, and clinical staff at multiple or remote sites.
  • Phase 7: Collect the Data. Data need to be collected at several steps along the way. If the trial is an interventional trial, pre- and postintervention data will be needed. Other types of research will require the tracking of patients over time. Data about physician-patient interactions may be difficult to collect, often requiring intensive qualitative methods.
  • Phase 8: Intervention. Conducting the intervention will require clinician and patient time, staff time, materials, travel, and communication costs.
  • Phase 9: Data Entry and Analysis. Database design and management and data entry are required. Data analysis is needed.
  • Phase 10: Disseminate Results. The dissemination of study results must include feedback to practices, the preparation of grant reports, publication, and presentations. In addition, primary care research projects should include arrangements for the translation of the research results into practice.

The costs related to each phase of operation must be funded (directly or indirectly) by one or more of 3 sources: (1) the academic or network infrastructure; (2) the practice site infrastructure, including the physician and patient; and (3) an extramural funding source.

The proportion of costs incurred by the various organizations or the extramural funding source will vary over time for any project. There is considerable overlap in how the costs of the various phases of research are distributed among the 3 types of sources. However, any extramural funding source will help support the research costs only in phase 5 and beyond.

Discussion

We have outlined the phases of research in a way that allows for some itemization of project expenses. The importance of the development and maintenance of a robust and well-funded support infrastructure is demonstrated by the fact that all activities up to and including those in phase 4 are performed before receiving grant funding.

Limitations

The limitations of this work include the lack of external validation of our model. Nonetheless, the basic outline provides one way to look at the costs of initiating and conducting research projects. We encourage other researchers to build on these ideas. In future work we intend to attach costs to the phases and activities outlined in this paper.

Conclusions

We hope that we have articulated the need for capital investment in the primary care research process, with special attention to practice-based research. This investment, which has paid great dividends in other areas of medicine, will help primary care investigators meet the challenge of developing a robust research enterprise. Such an investment will help us to ensure that the questions asked are important ones for primary care clinicians and that the answers will ultimately pay dividends in the health of our population in the same way research in other areas of medicine has.

A significant portion of research project costs is incurred before the receipt of grant funds. This poses a problem for the initiation of primary care research, especially in community practice settings. Potential investigators need financial support for staff time, training, pilot work, and grant proposal writing if primary care researchers are to compete successfully for grant funds. To find this support, we need to understand and eventually quantify the actual costs of research with attention to those that are incurred before the receipt of grant funds.

We outline 10 phases of the research process and provide a model for understanding where costs are incurred and by whom. Costs include those associated with maintaining practice interest in research, supporting practice participation, and disseminating research findings. They may be incurred by either an academic center or a research network, by the practices and physicians themselves, or by an extramural funding source.

The needed investment for initiating primary care research can be itemized and, with further research, quantified. This will enhance the arguments for capital investments in the primary care research enterprise.

The need for a strong research base for primary care has been generally acknowledged in the United States and elsewhere for nearly 30 years.1-5 Still, family physicians and other primary care physicians are not doing well in the competition for National Institutes of Health (NIH) funding6; this situation has changed little in more than a decade.7 Although it has been argued that the amount of NIH funding is proportional to the burden of disease,8 these analyses have not considered the potential impact of federal funding on disease burden if it were more available for research in different settings, such as those of community primary care. For example, the burden of liver disease may be reduced more by primary care research directed to helping physicians treat patients who drink too much9 than by research on liver transplantation.

A significant portion of research project costs is incurred before the receipt of grant funds. This poses a major problem for the development of a primary care research enterprise. Researchers, especially new ones, require financial support for investigator and staff time, training, pilot work, and grant proposal writing to compete successfully for grant funds. Although some institutional funding is available in academic medical centers to support the initiation of research, there is little or no comparable resource in community practices. These “laboratories” for most practice-based primary care research must find ways to integrate research activities with direct patient care needs, and a culture of support for inquiry needs to be developed and sustained along with a supporting infrastructure.

Start-up support is being reduced even within academic medical centers, and this support is especially critical for young faculty and for pilot work.10,11 The negative impact of this, while significant for all research,12 may be even more problematic for the nascent field of primary care research, which relies disproportionately on internal resources,13 and especially for practice-based research, since community physicians generally lack institutional resources. Furthermore, the critical importance of primary care clinical services to academic medical centers, with the resulting demands on faculty, can detract from allocation of time and money to research activities.14 To add to the problem of initiating research in primary care, there is evidence of a bias against patient-oriented research compared with that which is laboratory oriented, making obtaining grant funds for clinical researchers even more difficult and time consuming.15

Although the NIH has proposed solutions for increasing the number of physicians engaged in clinical research,16 the problem of developing researchers capable of maintaining research funding cycles in the primary care specialties has not been adequately addressed at the national level. Although concerned with clinical research, the NIH has not made primary care research a priority. Even programs that attempt to develop primary care researchers fail to take into account associated costs.17

In part, primary care’s disappointing research productivity has been due to a lack of the capital investment needed to develop robust research infrastructures (which include practice-based laboratories) and the limited availability of the financial and institutional support that investigators need to apply for project funding. This lack of an adequate infrastructure and sufficient funding to invest in the start-up process before the receipt of grant funding has proved to be a nearly insurmountable barrier to potential primary care investigators. It has been less a barrier to faculty in other disciplines in which long histories of grant-funded projects have enabled them to use resources from previously funded projects as the start-up capital for future ones. Although mechanisms are in place in some primary care departments for a capital investment of funds and for protected time and mentoring, these resources are generally limited and are threatened. A further problem exists in that even with start-up funding it may be difficult, if not impossible, to sustain a research program with a limited number of grant-funded projects running at any one time.18

 

 

Despite its critical role in the development of a research enterprise, the requirement for support for start-up efforts has not been quantified, and no scheme for such quantification has been published. Appropriately, grant budgets do not include the costs of getting to the point of grant submission. However, costs are incurred that must be covered by some source.

We provide a model that lists categories that will allow for the quantification of primary care research costs, including those incurred before the receipt of grant funds (Figure). In this model we assume that a significant portion of primary care research will be practice based, and thus we have included in our model costs related to the practices. One way of developing and using a “laboratory” for practice-based research is through the development and use of a practice-based research network, and thus these costs are also reflected in our model. We acknowledge that many aspects of the model would also apply to research in other settings, including basic science research and traditional clinical research in academic settings.

Methods

To develop our model, a group of University of Wisconsin and Wisconsin Research Network investigators experienced in primary care research explored the activities and associated costs necessary for conducting research projects. This group included an academic family physician (J.W.B.), a community family physician (D.H.), and 3 experienced research staff members (P.W., M.B.P., L.M.). We began with 4 core assumptions and then identified 10 phases of activity in the research process, the first 4 of which occur before the receipt of grant funding.

Four Assumptions

On the basis of our collective experience, our group made 4 assumptions that are important for our analysis of the costs associated with primary care research. These assumptions are:

  1. Expensive phases of the research process occur before the receipt of grant funds. It is therefore difficult to initiate major research solely through the grant-funding process. Many activities related to developing hypotheses, determining research methods, doing pilot work, and producing fundable proposals must occur before grant funding. Based on our collective experiences in applying for federal funding, we estimate that an investigator requires approximately a year of full-time equivalent work (eg, 25% time over 4 years) to get his or her first R01 grant funding.19-21 An unsuccessful application by one skilled individual was estimated to cost 220 hours of effort, exclusive of the time of staff and colleagues.22
  2. We need community practice settings for primary care research, and their research activities should be rewarded at approximately the same rate as other practice activities. Not only are these settings critical when physician practice is the object of the research, but it also seems that patient recruitment may be better (possibly with less selection bias) in community practices,23 since more patients are served by these than academic practices. Physicians and patients in community practice settings cannot participate without remuneration, especially when many studies and more time-consuming and sophisticated interventional studies are done. This is not only an issue of physician volunteerism. More physicians and staff are members of corporate medical entities that are beginning to insist on reimbursement for every corporate activity. Generally, pharmaceutical research is the only research that has budgeted adequate reimbursement for practices.
  3. Patients must not incur costs for participating in research activities. Making patients financially support research will reduce participation and potentially increase selection bias.
  4. An exact calculation for the budgeting of research activities across various primary care settings is not possible, since expenses are organization- and project-dependent. However, general estimates could be fit into the model.

The Research Process Before the Receipt of Grant Funding

The costs of research in primary care can be classified into 10 phases of operation by the series of tasks that have to be accomplished and by the organizations that will be required to accomplish them. Although our list may not exhaust the possible range of phases and organizations, it can serve as a framework for discussion of the resources needed to conceptualize a project, apply for funding, and carry out research. Not all phases are applicable to all projects, but in general most research will require activity in most phases.

  • Phase 1: Develop and Maintain a Commitment to Research. Regardless of whether a formal research network is used, researchers must convince the practice community to support research efforts, especially since projects that originate within academic departments may be removed from the interests and concerns of physicians in community practice. If a research network is involved as a means to maintain the “laboratory,” an ongoing investment in network operations is required. We note that even ongoing successful research institutions generally cannot rely solely on grant funding.24 These institutions often have some base support from other sources, such as state funding.
  • Phase 2: Conceptualize and Design a Project. Time and energy must be invested in literature reviews, conferences, and consultations to design a research project that builds on existing experience and knowledge. The active involvement of clinicians at this stage helps to ensure buy-in and, more important, ensures that the results of the research are likely to be relevant to practice.
  • Phase 3: Pilot-Test and Revise the Design. Generally, it is necessary to conduct some preliminary research to demonstrate feasibility and work out methodologic details before writing the grant proposal. Data collection instruments may have to be identified or developed, and some statistical analysis should be done.
  • Phase 4: Write and Submit the Grant Proposal. Preparing a grant proposal requires time for writing, obtaining institutional review board approval, realistic budgeting, consultation, and revision. These efforts may not achieve the desired goal of funding, however; only 20% of NIH submissions receive funding on the first submission.
 

 

The Research Process After the Receipt of Grant Funding

  • Phase 5: Recruit the Practice Sites, Clinicians, and Patients. The larger, more complex, and more intrusive the research project, the more difficult this stage of operation is. The expenses of this phase have recently been described25-27 and quantified.28
  • Phase 6: Train the Researchers, Clinicians, and Staff. It may prove necessary to provide training for the personnel involved in the project. They may include research project staff, clinicians, and clinical staff at multiple or remote sites.
  • Phase 7: Collect the Data. Data need to be collected at several steps along the way. If the trial is an interventional trial, pre- and postintervention data will be needed. Other types of research will require the tracking of patients over time. Data about physician-patient interactions may be difficult to collect, often requiring intensive qualitative methods.
  • Phase 8: Intervention. Conducting the intervention will require clinician and patient time, staff time, materials, travel, and communication costs.
  • Phase 9: Data Entry and Analysis. Database design and management and data entry are required. Data analysis is needed.
  • Phase 10: Disseminate Results. The dissemination of study results must include feedback to practices, the preparation of grant reports, publication, and presentations. In addition, primary care research projects should include arrangements for the translation of the research results into practice.

The costs related to each phase of operation must be funded (directly or indirectly) by one or more of 3 sources: (1) the academic or network infrastructure; (2) the practice site infrastructure, including the physician and patient; and (3) an extramural funding source.

The proportion of costs incurred by the various organizations or the extramural funding source will vary over time for any project. There is considerable overlap in how the costs of the various phases of research are distributed among the 3 types of sources. However, any extramural funding source will help support the research costs only in phase 5 and beyond.

Discussion

We have outlined the phases of research in a way that allows for some itemization of project expenses. The importance of the development and maintenance of a robust and well-funded support infrastructure is demonstrated by the fact that all activities up to and including those in phase 4 are performed before receiving grant funding.

Limitations

The limitations of this work include the lack of external validation of our model. Nonetheless, the basic outline provides one way to look at the costs of initiating and conducting research projects. We encourage other researchers to build on these ideas. In future work we intend to attach costs to the phases and activities outlined in this paper.

Conclusions

We hope that we have articulated the need for capital investment in the primary care research process, with special attention to practice-based research. This investment, which has paid great dividends in other areas of medicine, will help primary care investigators meet the challenge of developing a robust research enterprise. Such an investment will help us to ensure that the questions asked are important ones for primary care clinicians and that the answers will ultimately pay dividends in the health of our population in the same way research in other areas of medicine has.

References

1. White KL, Williams TL, Greenberg BG. The ecology of medical care. N Engl J Med 1961;265:885-92.

2. Lanier D, Clancy C. Primary care research: current challenges, future needs. J Fam Pract 1997;44:434-38.

3. Donaldson MS, Yordy KD, Lorh KN, Vanselow NA, eds, Primary care: America’s health in a new era. Washington, DC: Institute of Medicine; 1996;216-46.

4. Nutting PA, Beasley JW, Werner JJ. Asking and answering questions in practice: practice-based research networks build the science base of family practice. JAMA 1999;281:686-88.

5. Culyer A. National Health Service. Research and Development Task Force. Supporting research and development in the NHS. London, England: Her Majesty’s Stationary Office; 1994.

6. Campos-Octcalt D, Senf J. Family medicine research funding. Fam Med 1999;31:709-12.

7. Culpepper L. Research funding for family medicine: dilemmas and options. Fam Med 1986;18:363-68.

8. Gross CP, Anderson GF, Powe NR. The relation between funding by the National Institutes of Health and the burden of disease. N Eng J Med 1999;340:1881-87.

9. Fleming MF, Barry KL, Manwell LB, Johnson MA, London R. Brief physician advice for problem alcohol drinkers: a randomized controlled trial in community-based primary care practices. JAMA 1997;277:1039-45.

10. Weissman JS, Saglam D, Campbell EG, Causino N, Blumenthal D. Market forces and unsponsored research in academic health centers. JAMA 1999;281:1093-98.

11. Campbell EG, Weissman JS, Blumenthal D. Relationship between market competition and the activities and attitudes of medical school faculty. JAMA 1997;278:222-26.

12. Moy E, Mazzaschi AJ, Levin RJ, Blake DA, Griner PF. Relationship between National Institutes of Health research awards to US medical schools and managed care market penetration. JAMA 1997;278:217-21.

13. Ruffin MT, Sheets KJ. Primary care research funding sources. J Fam Pract 1992;35:281-87.

14. Weiss BD. The death of academic family medicine: can it be prevented? Fam Med 1995;27:139-42.

15. Williams GH, Wara DW, Carbone P. Funding for patient-oriented research: critical strain on a fundamental linchpin. JAMA 1997;287:227-32.

16. Nathan DG. The National Institutes of Health Director’s Panel on Clinical Research. Clinical research: perceptions, reality and proposed solutions. JAMA 1998;280:1427-31.

17. Curtis P, Shaffer VD, Goldstein AO, Seufert L. Counting the cost of an NRSA Primary Care Research Fellowship Program. Fam Med 1998;30:19-23.

18. Culpepper L. The internal environment: critical functions in conducting network research. In: Practice-based research networks in the 21st century: the pearls of research. Proceedings from the conference convened by the AAFP Task Force to Enhance Family Practice Research. Leawood, Kan: American Academy of Family Physicians; 1999.

19. McBride P. Personal communication; 1999.

20. Fleming M. Personal communication; 1999.

21. Brown RL. Personal communication; 1999.

22. Roberts R. Personal communication; 1999.

23. Kelly RB, McMahon SH, Hazey JA. Does practice location or academic connection affect recruitment of patients as research subjects? Fam Pract Res J 1992;12:177-84.

24. Association of American Medical Colleges. Maximizing the investment: principles to guide the federal-academic partnership in biomedical and health sciences research. Washington, DC: Association of American Medical Colleges; 1998.

25. Levinson W, Dull VT, Roter RL, Chaumeton N, Frankel RM. Recruiting physicians for office-based research. Med Care 1998;36:934-37.

26. Carey TS, Kinsinger L, Keyserling T, Harris R. Research in the community: recruiting and retaining practices. J Community Health 1996;21:315-27.

27. Borgiel AEM, Dunn EV, Lamont CT, et al. Recruiting family physicians as participants in research. Fam Pract 1989;6:168-72.

28. McBride P, Massoth KM, Underbakke G, Solberg LI, Beasley J, Plane MB. Recruitment of practices for primary care research: experiences in a preventive services clinical trial. J Fam Pract 1996;43:389-95.

References

1. White KL, Williams TL, Greenberg BG. The ecology of medical care. N Engl J Med 1961;265:885-92.

2. Lanier D, Clancy C. Primary care research: current challenges, future needs. J Fam Pract 1997;44:434-38.

3. Donaldson MS, Yordy KD, Lorh KN, Vanselow NA, eds, Primary care: America’s health in a new era. Washington, DC: Institute of Medicine; 1996;216-46.

4. Nutting PA, Beasley JW, Werner JJ. Asking and answering questions in practice: practice-based research networks build the science base of family practice. JAMA 1999;281:686-88.

5. Culyer A. National Health Service. Research and Development Task Force. Supporting research and development in the NHS. London, England: Her Majesty’s Stationary Office; 1994.

6. Campos-Octcalt D, Senf J. Family medicine research funding. Fam Med 1999;31:709-12.

7. Culpepper L. Research funding for family medicine: dilemmas and options. Fam Med 1986;18:363-68.

8. Gross CP, Anderson GF, Powe NR. The relation between funding by the National Institutes of Health and the burden of disease. N Eng J Med 1999;340:1881-87.

9. Fleming MF, Barry KL, Manwell LB, Johnson MA, London R. Brief physician advice for problem alcohol drinkers: a randomized controlled trial in community-based primary care practices. JAMA 1997;277:1039-45.

10. Weissman JS, Saglam D, Campbell EG, Causino N, Blumenthal D. Market forces and unsponsored research in academic health centers. JAMA 1999;281:1093-98.

11. Campbell EG, Weissman JS, Blumenthal D. Relationship between market competition and the activities and attitudes of medical school faculty. JAMA 1997;278:222-26.

12. Moy E, Mazzaschi AJ, Levin RJ, Blake DA, Griner PF. Relationship between National Institutes of Health research awards to US medical schools and managed care market penetration. JAMA 1997;278:217-21.

13. Ruffin MT, Sheets KJ. Primary care research funding sources. J Fam Pract 1992;35:281-87.

14. Weiss BD. The death of academic family medicine: can it be prevented? Fam Med 1995;27:139-42.

15. Williams GH, Wara DW, Carbone P. Funding for patient-oriented research: critical strain on a fundamental linchpin. JAMA 1997;287:227-32.

16. Nathan DG. The National Institutes of Health Director’s Panel on Clinical Research. Clinical research: perceptions, reality and proposed solutions. JAMA 1998;280:1427-31.

17. Curtis P, Shaffer VD, Goldstein AO, Seufert L. Counting the cost of an NRSA Primary Care Research Fellowship Program. Fam Med 1998;30:19-23.

18. Culpepper L. The internal environment: critical functions in conducting network research. In: Practice-based research networks in the 21st century: the pearls of research. Proceedings from the conference convened by the AAFP Task Force to Enhance Family Practice Research. Leawood, Kan: American Academy of Family Physicians; 1999.

19. McBride P. Personal communication; 1999.

20. Fleming M. Personal communication; 1999.

21. Brown RL. Personal communication; 1999.

22. Roberts R. Personal communication; 1999.

23. Kelly RB, McMahon SH, Hazey JA. Does practice location or academic connection affect recruitment of patients as research subjects? Fam Pract Res J 1992;12:177-84.

24. Association of American Medical Colleges. Maximizing the investment: principles to guide the federal-academic partnership in biomedical and health sciences research. Washington, DC: Association of American Medical Colleges; 1998.

25. Levinson W, Dull VT, Roter RL, Chaumeton N, Frankel RM. Recruiting physicians for office-based research. Med Care 1998;36:934-37.

26. Carey TS, Kinsinger L, Keyserling T, Harris R. Research in the community: recruiting and retaining practices. J Community Health 1996;21:315-27.

27. Borgiel AEM, Dunn EV, Lamont CT, et al. Recruiting family physicians as participants in research. Fam Pract 1989;6:168-72.

28. McBride P, Massoth KM, Underbakke G, Solberg LI, Beasley J, Plane MB. Recruitment of practices for primary care research: experiences in a preventive services clinical trial. J Fam Pract 1996;43:389-95.

Issue
The Journal of Family Practice - 49(11)
Issue
The Journal of Family Practice - 49(11)
Page Number
985-989
Page Number
985-989
Publications
Publications
Article Type
Display Headline
The Cost of Primary Care Research
Display Headline
The Cost of Primary Care Research
Legacy Keywords
,Family practiceprimary health careresearchresearch support. (J Fam Pract 2000; 49:985-989)
Legacy Keywords
,Family practiceprimary health careresearchresearch support. (J Fam Pract 2000; 49:985-989)
Sections
Article Source

PURLs Copyright

Inside the Article

Recruitment of Private Practices for Primary Care Research Experience in a Preventive Services Clinical Trial

Article Type
Changed
Fri, 01/18/2019 - 10:41
Display Headline
Recruitment of Private Practices for Primary Care Research Experience in a Preventive Services Clinical Trial
Article PDF
Issue
The Journal of Family Practice - 43(4)
Publications
Sections
Article PDF
Article PDF
Issue
The Journal of Family Practice - 43(4)
Issue
The Journal of Family Practice - 43(4)
Publications
Publications
Article Type
Display Headline
Recruitment of Private Practices for Primary Care Research Experience in a Preventive Services Clinical Trial
Display Headline
Recruitment of Private Practices for Primary Care Research Experience in a Preventive Services Clinical Trial
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Article PDF Media

Responses to Questions by Medical Students About Family Practice

Article Type
Changed
Fri, 01/18/2019 - 10:29
Display Headline
Responses to Questions by Medical Students About Family Practice
Article PDF
Issue
The Journal of Family Practice - 26(2)
Publications
Sections
Article PDF
Article PDF
Issue
The Journal of Family Practice - 26(2)
Issue
The Journal of Family Practice - 26(2)
Publications
Publications
Article Type
Display Headline
Responses to Questions by Medical Students About Family Practice
Display Headline
Responses to Questions by Medical Students About Family Practice
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Article PDF Media

Communication A Simple Measurement of Family Care in Medical Practice

Article Type
Changed
Fri, 01/18/2019 - 09:52
Display Headline
Communication A Simple Measurement of Family Care in Medical Practice
Article PDF
Issue
The Journal of Family Practice - 21(1)
Publications
Sections
Article PDF
Article PDF
Issue
The Journal of Family Practice - 21(1)
Issue
The Journal of Family Practice - 21(1)
Publications
Publications
Article Type
Display Headline
Communication A Simple Measurement of Family Care in Medical Practice
Display Headline
Communication A Simple Measurement of Family Care in Medical Practice
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Article PDF Media

Excellence—The Next Priority in Family Practice

Article Type
Changed
Fri, 01/18/2019 - 10:22
Display Headline
Excellence—The Next Priority in Family Practice
Article PDF
Issue
The Journal of Family Practice - 19(3)
Publications
Sections
Article PDF
Article PDF
Issue
The Journal of Family Practice - 19(3)
Issue
The Journal of Family Practice - 19(3)
Publications
Publications
Article Type
Display Headline
Excellence—The Next Priority in Family Practice
Display Headline
Excellence—The Next Priority in Family Practice
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Article PDF Media

Responses to Questions Frequently Asked by Medical Students About Family Practice

Article Type
Changed
Fri, 01/18/2019 - 09:57
Display Headline
Responses to Questions Frequently Asked by Medical Students About Family Practice
Article PDF
Issue
The Journal of Family Practice - 17(6)
Publications
Sections
Article PDF
Article PDF
Issue
The Journal of Family Practice - 17(6)
Issue
The Journal of Family Practice - 17(6)
Publications
Publications
Article Type
Display Headline
Responses to Questions Frequently Asked by Medical Students About Family Practice
Display Headline
Responses to Questions Frequently Asked by Medical Students About Family Practice
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Article PDF Media

Using Private Practice Settings for Academically Intensive Family Practice Clerkships

Article Type
Changed
Fri, 01/18/2019 - 09:55
Display Headline
Using Private Practice Settings for Academically Intensive Family Practice Clerkships
Article PDF
Issue
The Journal of Family Practice - 17(5)
Publications
Sections
Article PDF
Article PDF
Issue
The Journal of Family Practice - 17(5)
Issue
The Journal of Family Practice - 17(5)
Publications
Publications
Article Type
Display Headline
Using Private Practice Settings for Academically Intensive Family Practice Clerkships
Display Headline
Using Private Practice Settings for Academically Intensive Family Practice Clerkships
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Article PDF Media

Ten Central Elements of Family Practice

Article Type
Changed
Fri, 01/18/2019 - 09:56
Display Headline
Ten Central Elements of Family Practice
Article PDF
Issue
The Journal of Family Practice - 16(3)
Publications
Sections
Article PDF
Article PDF
Issue
The Journal of Family Practice - 16(3)
Issue
The Journal of Family Practice - 16(3)
Publications
Publications
Article Type
Display Headline
Ten Central Elements of Family Practice
Display Headline
Ten Central Elements of Family Practice
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Article PDF Media