8/11/2009 11:38:07 AM By E.J. Reedy
Scott Shane highlighted in his blog yesterday some interesting data from the Cooperative Institutional Research Program (CIRP) at the University of California, Los Angeles, related to the interests of college freshmen in business.  The CIRP Freshman Survey is part of a larger effort at CIRP to measure the college experience and something which caught my interest about a year ago, so I wanted to share more detail on the survey and some additional tabulation from it which will help researchers to see why there is some great potential here.  In particular, this data set would seem ripe for some doctoral research, as CIRP is open to research proposals, and to my knowledge, very little has been done with this data looking at career choice.

From the CIRP website...

The Cooperative Institutional Research Program (CIRP) Freshman Survey is administered by the Higher Education Research Institute (HERI) at UCLA. Informing colleges and universities since 1966, the CIRP Freshman Survey has collected data on over 13 million students at over 1,900 institutions, and is the largest American study of higher education. The CIRP Freshman Survey is designed to provide comprehensive information on your incoming first-year students. It can be used by itself, or, when used in conjunction with the Your First College Year Survey (YFCY) and the College Senior Survey (CSS), provides valuable baseline data for a longitudinal assessment. The CIRP Freshman Survey is used by researchers and practitioners to examine readiness for college, how students choose colleges, student values and beliefs about diversity and civic engagement, and student expectations.

Participating institutions receive a detailed profile of their entering freshman class, as well as national normative data for students in similar types of institutions. These campus profile reports, together with the national normative profile, provide important data that can be useful in a variety of program and policy areas:
  • Admissions and recruitment
  • Academic program development, review and self-assessment
  • Institutional self-study and accreditation activities
  • Public relations and advancement/development
  • Institutional research and assessment
  • Retention studies
  • Longitudinal research about the impact of policies and programs
Although the normative data provided with the institutional reports (and published annually in The American Freshman) are based on the population of first-time, full-time freshmen, participating institutions also receive separate reports for their part-time and transfer students. Additionally, participating campuses can obtain supplemental reports profiling students by various subgroups (for example, by intended major or career, by academic ability, by home state).

Now Scott's post highlighted the response to a question which reads as follows in the 2009 questionnaire, although the response categories have likely changed over the years.

Please indicate the importance to you personally of each of the following: (Mark one for each item)
Response categories - Essential, Very Important, Somewhat Important, Not Important
  • Becoming accomplished in one of the performing arts (acting, dancing, etc.)..........................
  • Becoming an authority in my field.........................................
  • Obtaining recognition from my colleagues for contributions to my special field..........................................
  • Influencing the political structure...........................................
  • Influencing social values.......................................................
  • Raising a family.....................................................................
  • Being very well off financially................................................
  • Helping others who are in difficulty.......................................
  • Making a theoretical contribution to science.........................
  • Writing original works (poems, novels, short stories, etc.)....
  • Creating artistic works (painting, sculpture, decorating, etc.)..
  • Becoming successful in a business of my own..................... [bold added]
  • Becoming involved in programs to clean up the environment..
  • Developing a meaningful philosophy of life...........................
  • Participating in a community action program........................
  • Helping to promote racial understanding..............................
  • Keeping up to date with political affairs.................................
  • Becoming a community leader..............................................
  • Improving my understanding of other countries and cultures..
  • Adopting “green” practices to protect the environment.........
What struck me most when I read Scott's summary of the data was the high level of response to the question.  According to Scott's tabulations, the measure has run between 40 and 50 percent of college freshmen choosing either "essential" or "very important" to the choice "Becoming successful in a business of my own" since at least 1976, with the exception of a period of time in the 1990s. 

In correspondence with John Pryor, one of the directors on these projects at UCLA, I had looked at another measure which the Freshmen Survey appears to have related to entrepreneurship, specifically, their probable career choice.  Here is the question from the 2009 survey:

Mark only three responses, one in each column [column headings - Your mother's occupation, Your father's occupation, Your probable occupation]
  • Accountant or actuary.....................
  • Actor or entertainer.........................
  • Architect or urban planner...............
  • Artist................................................
  • Business (clerical)...........................
  • Business executive (management, administrator)........
  • Business owner or proprietor..........[bold added]
  • Business salesperson or buyer.......
  • Clergy (minister, priest)...................
  • Clergy (other religious)....................
  • Clinical psychologist........................
  • College administrator/staff...............
  • College teacher...............................
  • Computer programmer or analyst...
  • Conservationist or forester..............
  • Dentist (including orthodontist)........
  • Dietitian or nutritionist......................
  • Engineer..........................................
  • Farmer or rancher...........................
  • Foreign service worker (including diplomat).......................
  • Homemaker (full-time).....................
  • Interior decorator (including designer)..
  • Lab technician or hygienist..............
  • Law enforcement officer..................
  • Lawyer (attorney) or judge..............
  • Military service (career)...................
  • Musician (performer, composer)......
  • Nurse...............................................
  • Optometrist......................................
  • Pharmacist......................................
  • Physician.........................................
  • Policymaker/Government................
  • School counselor.............................
  • School principal or superintendent..
  • Scientific researcher........................
  • Social, welfare, or recreation worker..
  • Therapist (physical, occupational, speech)........................................
  • Teacher or administrator (elementary).................................
  • Teacher or administrator (secondary)..................................
  • Veterinarian.....................................
  • Writer or journalist...........................
  • Skilled trades...................................
  • Laborer (unskilled)...........................
  • Semi-skilled worker.........................
  • Unemployed....................................
  • Other................................................
  • Undecided.......................................
John and I had corresponded about his survey because he presented a paper at the 2008 Kauffman Symposium on Entrepreneurship and Innovation Data in which he highlighted the need from his perspective to update the occupation choices represented on the survey for a modern world.  Indeed, in his paper he highlighted the following, "approximately 17 percent of incoming students cannot find a suitable occupation on the list and  answer with 'other' (another 14 percent respond with 'undecided'). In 2008, approximately one out of five seniors answered 'other' for the probable career after graduation on the CSS."

In corresponding with John, he was nice enough to send me the time series for the answers to "Your probable occupation" that related to business ownership, which with his permission, I have included below.  



With this response garnering between 1.6 and 3.7 percent over the course of the survey, it is at an extremely different level than the question Scott highlighted.  Obviously, both are relevant, but more work needs to be done to understand and interact the responses on individual records.  Indeed, if you are a researcher doing work with this data, please let me know.  What I would hypothesize is the question Scott highlighted has more to do with interest at some point - a question polling firms have asked in the adult population at different times - while the question which I highlight is probably more akin to the nascent entrepreneurs or people who plan to start a business in the next few years.  Now, this is only conjecture and there are other places in this survey where the idea of entrepreneurship would seem to appear, but the conclusions which we draw from the data can differ and should be investigated more.  Indeed, the question which I highlight remains closer to historic highs than the question which Scott highlighted, but it should be noted that neither question is at a peak currently. 

It will be interesting to see what the coming years of data show in these trends and what work can be done to improve measurement of entrepreneurship and innovation in the CIRP surveys.  John Pryor also asked that I share this on the post: "HERI is interested in exploring the development of entrepreneurship (among other areas) with follow-up surveys of these students as they have been out in the working world."  I believe John is referencing surveys like what is planned shortly on "becoming scientists" as listed on their website.


7/21/2009 12:59:34 PM By E.J. Reedy
Reports out this morning from the official monitoring the Troubled Asset Relied Program for the U.S. Congress highlight the difficulty of tracking the success of this program because of a lack of data.  These reports reminded me of a recent presentation I sat through from Statistics Canada discussing two of their programs for monitoring lending to small businesses in Canada.  A bit more background on the two projects as I understand them.
  • Survey on Financing of Small and Medium Enterprises.  Completed every three years, with most recent data available from 2007, this survey gets detailed business financing data from establishments.  You can read much more on the details of sampling, etc.
  • Survey of Suppliers of Business Financing.  Completed on roughly the same cycle but gathering data from banks instead of businesses, this survey gets aggregate information on bank portfolios.  Read more on the details.
What I found most interesting about hearing Statistics Canada talk about both collection efforts back-to-back was the informal comments that were given about the merits of collecting data from banks rather than businesses.  As I remember, the comments basically alluded to the difficult time that Statistics Canada has of getting banks to provide data for their survey, even though the survey is mandatory under Canadian statutes.  On the survey of businesses, they have a much easier time of getting the data, relatively, and have felt they are able to do more detailed manipulations with the data, providing richer outputs, and helping that program to have more stable funding support. 

What I read into these stories is that banks hold a great deal of power in deciding who gets what information, even when the world is watching closely or statutes compel them to participate. 

7/6/2009 4:42:00 AM By E.J. Reedy

The National Science Foundation (NSF) has been engaged in a wholesale redesign of many of their surveys in recent years and today I want to talk about one of these surveys, the Survey of Research and Development Expenditures at Universities and Colleges.  NSF's proposed redesign includes the addition of a new module on commercialization and technology transfer, which I think is quite exciting.  You can find out more about their proposed redesign or read some of our comments on the redesign below. 

There is no doubt in my mind that the role universities are being asked to play in society has changed over recent years.  Many universities are now seen to have a significant economic development mission.  As such, I think universities should welcome many of the changes that NSF is proposing.   

NSF letter 0609.pdf (110.81 kb)

NSF Attachment 1.pdf (558.88 kb)


7/2/2009 4:00:00 AM By E.J. Reedy

A month or so ago I blogged on some really exciting proposed changes to the National Longitudinal Survey of Youth (NLSY) at the Bureau of Labor Statistics (BLS) (see overview blog and earlier draft comments).  Well, we have finalized and sent our final letter to BLS on the NLSY changes so I wanted to post our final thoughts.  I am sure BLS would welcome additional letters and comments on their proposed changes.  Thanks to those who provided some comments, namely Rob Fairlie and the experts at Mathematica.

BLS Attachment

BLS Attachment 2


6/10/2009 3:05:39 PM By E.J. Reedy

A couple of weeks ago I called for comment on the Bureau of Labor Statistics' proposed new entrepreneurship questions in their next round of questions for the National Youth Longitudinal Survey 1979.  Since that time we have been engaged in a review ourselves and with Mathematica Policy Research, our survey vendor for the Kauffman Firm Survey.  As the deadline for comments is quickly approaching, I will be sending this by the close of business Thursday.  In the meantime, in the spirit of openness, I am posting a draft letter and attachments here.  We remain open to other ideas from scholars or individuals with survey research experience on this population. 

BLS.pdf (90.09 kb)

BLS attachment 1.pdf (106.66 kb)

BLS attachment 2.pdf (59.93 kb)


5/31/2009 12:58:00 PM By E.J. Reedy

I have a lot of respect for the operation Denny Dennis runs at the National Federation of Independent Businesses (NFIB).  Denny is in charge of the small business polls that NFIB releases eight times a year looking at small businesses (under 250 employees, I believe).  NFIB, and I believe Denny, have been doing these continually for more than twenty years.  In that time, they have covered a lot of questions which are interesting but would never get asked by most federal agencies.  And in the last year they have taken the very forward-looking step of making all those survey questions available in a searchable interface which brings back both interesting survey data but also puts it in an easy to read format: 411 Small Business Facts

One of their weekly emails highlighted a recent question which I thought would have a lot of interest in the current environment:

  • Was one or more of the mortgages taken out on this property to provide capital for your business?
    Twenty-six (26) percent of small employers who own their residence and have a mortgage on that property had one or more of the mortgages taken out on this property to provide capital for their business (Q#18d). Eighteen (18) percent of small employers took out one or more mortgages on their residence to provide capital for their business (Q#18d). 
Read the full question and take a look at other questions.

5/27/2009 10:50:00 AM By E.J. Reedy

A lot goes into making a survey high-quality but also affordable.  One choice that we made with the Kauffman Firm Survey to save on costs and try to achieve higher retention rates was to field a survey which used dual modes of collection - CATI or computer-assisted telephone interviewing and the internet.  In doing so with our panel of nearly 5,000 businesses, we've been able to cut costs on the whole project and extend the period of data collection.  In a field which desperately needs more longitudinal surveys, I think there are some lessons to be learned:

  • It takes time.  Initially respondents were much less likely to choose web vs. CATI because they didn't know our effort and they didn't fully trust us.  With time, the response rates via the web have gone from the low thirties to the upper sixties.
  • It saves money.  The above mentioned transition has cut our actual cost per interview down considerably.
  • It is more convenient.  We've been able to make it very easy for respondents to stay in our sample, thus achieving nearly 80 percent retention rates.
     

These are just a few reasons why this dual mode choice has been good for Kauffman.  In a new research paper studying the effect of this choice and any biases that it might cause in the sample, researchers at Mathematica find very few indications that the CATI vs. web option (or those who switch their response choices) matters at all.  Perhaps the biggest possible influences of mode effects are industry and employer vs. non-employer.


4/7/2009 5:36:00 AM By E.J. Reedy

Eric Von Hippel of MIT and coauthors have been engaged with some interesting research in the Netherlands and Canada.

  • De Jong, Jeroen P.J. and Von Hippel, Eric A.,Measuring User Innovation in Dutch High Tech SMEs: Frequency, Nature and Transfer to Producers(February 27, 2009). MIT Sloan Research Paper No. 4724-09. Available at SSRN: http://ssrn.com/abstract=1352496
  • Gault, Fred and Von Hippel, Eric A.,The Prevalence of User Innovation and Free Innovation Transfers: Implications for Statistical Indicators and Innovation Policy(February 3, 2009). MIT Sloan Research Paper No. 4722-09. Available at SSRN: http://ssrn.com/abstract=1337232

The Netherlands work is based on survey questions which were added to an existing panel survey that the EIM manages.  Here is how the De Jong and Von Hippel describe the data in their paper:

"The Dutch research institute EIM manages a panel of high-technology SMEs in the Netherlands which it surveys every year. The panel was created to explore the nature of high-tech SMEs’ business processes, and to assess the effectiveness of innovation and entrepreneurship policies (EIM, 2006). In the fall of 2007, EIM gave the authors of this paper permission to include several questions about user innovation in this annual survey, and the data and findings we report upon here are derived from responses to these questions. 

The panel defines high-tech firms as those who actively engage in R&D, and who develop and/or apply new technologies in their products (Grinstein and Goldman, 2006).  They are innovative and process-intensive firms. Following the Dutch definition of SMEs, the panel contains only independent commercial organizations with 1-100 employees. Data were collected with computer assisted telephone interviewing. During a period of four weeks in November and December 2007, surveys were completed with 514 of the 779 panelists (66%). Respondents were all directors or managers with a good overview of their firms’ practices, including innovation. It appeared that since the start of the panel (November 2005), 16 respondents had been purchased by larger organizations, or had grown to the point of having more than 100 employees. These respondents were discarded from further analysis. Our data therefore reflect answers by 498 respondents. Since all respondents were participants in a panel that had been surveyed before (EIM, 2006), we were able to enrich our data by including previouslycollected data on background variables such as industry classifications."

What is interesting about this work is its focus on user innovation development, the assistance from producers and others in developing those innovations, the costs related to the innovations, and the ultimate transfer of the innovations to others.  The authors report that fifty-four percent of their sample report "developing new and/or modifying existing process equipment or software for in-house use within the last 3 years" at a cost of more than €235,000.  Of these developments, the authors find that a quarter have been transferred back to equipment producers or software vendors for commercial sale with 48 percent of these transfers happening at no charge.  The authors go on to report that "narrowcasting information about their innovations to equipment producers which whom they have a preexisting relationship" is the preference of the innovators.  Most of the questions used are available in Table 1 of the paper (although the questions are shown out of context from the larger survey).  

The work on Canada is perhaps a better piece for those wanting an overview of this line of research.  Questionnaires for this work are available online.  Stats Canada undertook this survey in in 2007 and early 2008.  Only manufacturing and logging establishments were surveyed with a more than 20 employees.  Many of the findings are in line with the Dutch study but by the nature of the survey population, we are able to see more into the costs associated with process innovations by "user firms," which the authors report could be close to 10 percent of all R&D expenditure in Canada.  In this paper, the authors also get into more detail on the possible policy implications of their work, for both statistical offices in terms of measurement and for policy makers wishing to promote societally beneficial dissemination of innovations. 

I would last like to applaud the researchers for their presentation of new survey research that is tied into the larger discussion of how innovation measurement can be improved.  In their conclusion they point out that the Oslo Manual, which defines much of how innovation measurement is standardized across countries, would not currently track many measures of innovation which the authors find to be prevalent.  Specifically, the authors indicate that the Oslo Manual would not consider an innovation which is developed by and consumed by users only as an innovation, because it had not been commercialized.  


3/31/2009 11:02:00 AM By E.J. Reedy

Family-ownership of firms isn't something that we deal with a lot at Kauffman, but it's something that the larger field considers a part of entrepreneurship.  As such, when I got an email inquiry today through our website on the subject and data available on family-owned firms, I decided to take a look.  I didn't go far because for this type of thing, in the United States, there is really only one great source, the Survey of Business Owners.  It's done every five years in conjunction with the Economic Census.  The most recent released data is from 2002.  And what I found really fascinated me:

Respondent firms 16,687,541 total - 4,091,884 employer firms; 12,595,657 non-employer firms

  • Family-owned, yes: 23.4 percent overall – 28.1 percent for employer firms; 21.9 percent for non-employers
  • Family-owned, no: 9.4 percent overall– 18.3 percent for employer firms; 6.5 percent for non-employers
  • Family-owned, only one owner: 63.6 percent overall - 51.0 percent for employer firms; 67.7 percent for non-employers
  • Family-owned, item not reported: 4.2 percent overall - 4.1 percent for employer firms; 4.2 percent for non-employers
Source: Table 4.  http://www.census.gov/prod/ec02/sb0200cscb.pdf

I'm still getting used to tables, etc. on the blog so apologies for the clunkiness here, but the basic message I wanted to show was that it's really interesting that a majority of firms in the United States are single-owner firms and yet these firms predominantly respond that they are "family-owned".  By my reading of the above, 87 percent of firms responded that they were family-owned.  Even close to 80 percent of employer firms reported being family-owned. 

3/30/2009 8:29:00 AM By E.J. Reedy

Last week, I received an email from the the National Association of Seed and Venture Funds.  In the email, the group talks of "taking a proactive approach to encouraging government entities to understand the value of offering incentives for early stage investment."  As such, they are doing two surveys on surveymonkey "to provide government officials and the media with information to support the need for increased early stage capital."  One survey was focused on the investor and one the professional support organization.  Given the audience of for this blog, I thought I'd pass along the professional support survey link, in case it applicable to readers.  This survey is obviously not meant to be very scientific, but if nothing else, readers can benefit from seeing the questions which are being asked. 

Professional Support Survey - This survey is for professional service providers, university/federal technology transfer groups and economic development professionals.

Everyone benefits through strong participation and we will share the results with those who participated. Any questions, please e-mail Marc Kramer at mkramer@nasvf.org.

 


 Previous  1 - 2 - 3 - 4 - 5  Next 

 
Developing better data is part of Kauffman's long-term strategy for advancing better research and policy on entrepreneurship and innovation. Data Maven is place you can connect with new data developments, provide us feedback on possible new projects, and contribute to the community seeking to improve entrepreneurship and innovation measurement.
E.J. Reedy is a manager in Research and Policy at the Kauffman Foundation. Learn more ...

Kauffman Data Symposiums

Subscribe via a feed reader
 To receive updates via email,
 enter your email address:

Delivered by FeedBurner