首页 | 本学科首页   官方微博 | 高级检索  
相似文献
 共查询到20条相似文献,搜索用时 46 毫秒
1.
Objective  Timely intervention, based on early identification of poor performance, is likely to help weaker medical students improve their performance. We wished to identify if poor performance in degree assessments early in the medical degree predicts later undergraduate grades. If it does, this information could be used to signpost strategically placed supportive interventions for our students.
Methods  We carried out a retrospective, observational study of anonymised databases of student assessment outcomes at the University of Aberdeen Medical School. Data were accessed for students who graduated in the years 2003−07 ( n  = 861). The main outcome measure was marks for summative degree assessments from the end of Year 2 to the end of Year 5.
Results  After adjustment for cohort, maturity, gender, funding source, intercalation and graduate status, poor performance (fail and borderline pass) in the Year 2 first semester written examination Principles of Medicine II was found to be a significant predictor of poor performance in all subsequent written examinations (all P  < 0.001). Poor performance in the Year 3 objective structured clinical examination (OSCE) was a significant predictor of poor performance in Year 4 and 5 OSCEs. Relationships between essay-based summative assessments were not significantly predictive. Male gender appeared to significantly predict poor performance.
Discussion  Examinations taken as early as mid-Year 2 can be used to identify medical students who would benefit from intervention and support. Strategic delivery of appropriate intervention at this time may enable poorer students to perform better in subsequent examinations. We can then monitor the impact of remedial support on subsequent performance.  相似文献   

2.
Context  The dissemination of objective structured clinical examinations (OSCEs) is hampered by requirements for high levels of staffing and a significantly higher workload compared with multiple-choice examinations. Senior medical students may be able to support faculty staff to assess their peers. The aim of this study is to assess the reliability of student tutors as OSCE examiners and their acceptance by their peers.
Methods  Using a checklist and a global rating, teaching doctors (TDs) and student tutors (STs) simultaneously assessed students in basic clinical skills at 4 OSCE stations. The inter-rater agreement between TDs and STs was calculated by kappa values and paired t -tests. Students then completed a questionnaire to assess their acceptance of student peer examiners.
Results  All 214 Year 3 students at the University of Göttingen Medical School were evaluated in spring 2005. Student tutors gave slightly better average grades than TDs (differences of 0.02–0.20 on a 5-point Likert scale). Inter-rater agreement at the stations ranged from 0.41 to 0·64 for checklist assessment and global ratings; overall inter-rater agreement on the final grade was 0.66. Most students felt that assessment by STs would result in the same grades as assessment by TDs (64%) and that it would be similarly objective (69%). Nearly all students (95%) felt confident that they could evaluate their peers themselves in an OSCE.
Conclusions  On the basis of our results, STs can act as examiners in summative OSCEs to assess basic medical skills. The slightly better grades observed are of no practical concern. Students accepted assessment performed by STs.  相似文献   

3.
INTRODUCTION: As we move from standard 'long case' final examinations to new objective structured formats, we need to ensure the new is at least as good as the old. Furthermore, knowledge of which examination format best predicts medical student progression and clinical skills development would be of value. METHODS: A group of medical students sat both the standard long case examination and the new objective structured clinical examination (OSCE) to introduce this latter examination to our Medical School for final MB. At the end of their pre-registration year, the group and their supervising consultants submitted performance evaluation questionnaires. RESULTS: Thirty medical students sat both examinations and 20 returned evaluation questionnaires. Of the 72 consultants approached, 60 (83%) returned completed questionnaires. No correlation existed between self- and consultant reported performance. The traditional finals examination was inversely associated with consultant assessment. Better performing students were not rated as better doctors. The OSCE (and its components) was more consistent and showed positive associations with consultant ratings across the board. DISCUSSION: Major discrepancies exist between the 2 examination formats, in data interpretation and practical skills, which are explicitly tested in OSCEs but less so in traditional finals. Standardised marking schemes may reduce examiner variability and discretion and weaken correlations across the 2 examinations. This pilot provides empirical evidence that OSCEs assess different clinical domains than do traditional finals. Additionally, OSCEs improve prediction of clinical performance as assessed by independent consultants. CONCLUSION: Traditional finals and OSCEs correlate poorly with one another. Objective structured clinical examinations appear to correlate well with consultant assessment at the end of the pre-registration house officer year.  相似文献   

4.
Peer assessment has been increasingly recommended as a way to evaluate the professional competencies of medical trainees. Prior studies have only assessed single groups measured at a single timepoint. Thus, neither the longitudinal stability of such ratings nor differences between groups using the same peer-assessment instrument have been reported previously. Participants were all members of 2 consecutive classes of medical students (n = 77 and n = 85) at the University of Rochester School of Medicine and Dentistry who completed Years 2 and 3 of medical school consecutively. All participants were evaluated by 6-12 classmates near the end of both Years 2 and 3. Main outcome measures were mean numerical ratings on peer-assessed scales of professional work habits (WH) and interpersonal attributes (IA). Both scales had high internal consistencies in both years (Cronbach's alpha 0.84-0.94). The IA and WH scales were moderately correlated with one another (r = 0.36 in Year 2, r = 0.28 in Year 3). Year 2 scores were predictive of Year 3 scores for both scales (WH: r = 0.64; IA; r = 0.62). Generalisability and decision analyses revealed that 1 class was consistently more discriminating with the WH scale, while the other was more discriminating with of the IA scale. Depending on the class, year and scale, the number of raters needed to achieve a reasonable reliability ranged between 7 and 28. Although Year 3 peer ratings were consistently higher than Year 2 peer ratings for both WH and IA, individual scores were highly correlated across the 2 years, despite the fact that different individuals were chosen as peer raters. Abilities appear to be stable between Years 2 and 3 of medical school. Groups may differ in their ability to discriminate different kinds of skills. Generalisability analysis can be used to discover these patterns within groups.  相似文献   

5.
OBJECTIVES: This study investigates: (1) which personality traits are typical of medical students as compared to other students, and (2) which personality traits predict medical student performance in pre-clinical years. DESIGN: This paper reports a cross-sectional inventory study of students in nine academic majors and a prospective longitudinal study of one cohort of medical students assessed by inventory during their first preclinical year and by university examination at the end of each pre-clinical year. SUBJECTS AND METHODS: In 1997, a combined total of 785 students entered medical studies courses in five Flemish universities. Of these, 631 (80.4%) completed the NEO-PI-R (i.e. a measure of the Five-Factor Model of Personality). This was also completed by 914 Year 1 students of seven other academic majors at Ghent University. Year end scores for medical students were obtained for 607 students in Year 1, for 413 in Year 2, and for 341 in Year 3. RESULTS: Medical studies falls into the group of majors where students score highest on extraversion and agreeableness. Conscientiousness (i.e. self-achievement and self-discipline) significantly predicts final scores in each pre-clinical year. Medical students who score low on conscientiousness and high on gregariousness and excitement-seeking are significantly less likely to sit examinations successfully. CONCLUSIONS: The higher scores for extraversion and agreeableness, two dimensions defining the interpersonal dynamic, may be beneficial for doctors' collaboration and communication skills in future professional practice. Because conscientiousness affects examination results and can be reliably assessed at the start of a medical study career, personality assessment may be a useful tool in student counselling and guidance.  相似文献   

6.
OBJECTIVES: To assess attitudes of medical students toward issues of racial diversity and gender equality and to ascertain changes in these attitudes during the pre-clinical curriculum. METHODS: Attitudes toward multiculturalism and gender equality were assessed using a 43-item questionnaire. The survey was completed by incoming Year 1 students in 2000 and 2001, and was completed again in 2002 by the students who had entered in 2000. Mean scores were analysed at baseline by gender, ethnic group and political affiliation using analysis of variance. The paired scores of the first and follow-up surveys of the 2000 entering class were compared using paired t-tests. RESULTS: Upon entry into medical school, women, minority group students and Democrats scored significantly higher on the cultural sensitivity scale than their comparison groups. No significant changes were seen overall in the matched data. However, minority groups showed a significant increase in scores, while Republicans and white men experienced a non-significant decline. In addition, incoming students judged cultural competency education to be important. The perceived need to increase the numbers of minority group doctors varied by gender, ethnic group and political affiliation. CONCLUSIONS: Among incoming medical students, perceptions of racial diversity and gender equality vary along ethnic, gender and political lines. Additionally, pre-clinical education was associated with increased cultural sensitivity by minority group students, but not by others. These findings demonstrate the continuing need for diversity in medical school and for medical students to recognise and address their personal and group biases.  相似文献   

7.
CONTEXT: Objective structured clinical examinations (OSCEs) can be used for formative and summative evaluation. We sought to determine the generalisability of students' summary scores aggregated from formative OSCE cases distributed across 5 clerkships during Year 3 of medical school. METHODS: Five major clerkships held OSCEs with 2-4 cases each during their rotations. All cases used 15-minute student-standardised patient encounters and performance was assessed using clinical and communication skills checklists. As not all students completed every clerkship or OSCE case, the generalisability (G) study was an unbalanced student x (case : clerkship) design. After completion of the G study, a decision (D) study was undertaken and phi (phi) values for different cut-points were calculated. RESULTS: The data for this report were collected over 2 academic years involving 262 Year 3 students. The G study found that 9.7% of the score variance originated from the student, 3.1% from the student-clerkship interaction, and 87.2% from the student-case nested within clerkship effect. Using the variance components from the G study, the D study suggested that if students completed 3 OSCE cases in each of the 5 different clerkships, the reliability of the aggregated scores would be 0.63. The phi, calculated at a cut-point 1 standard deviation below the mean, would be approximately 0.85. CONCLUSIONS: Aggregating case scores from low stakes OSCEs within clerkships results in a score set that allows for very reliable decisions about which students are performing poorly. Medical schools can use OSCE case scores collected over a clinical year for summative evaluation.  相似文献   

8.
Context One goal of undergraduate assessment is to test students’ (future) performance. In the area of skills testing, the objective structured clinical examination (OSCE) has been of great value as a tool with which to test a number of skills in a limited time, with bias reduction and improved reliability. But can OSCEs measure undergraduate internship expertise in basic clinical skills? Methods Undergraduate students (n = 32) were given a questionnaire listing 182 basic clinical skills. We asked them to score the number of times they had performed each skill during their internships (a 12‐month period in Year 6). We assessed the students at the end of Year 5 (before the start of their internships) and again at the start of Year 7 (undergraduate training takes 7 years in Belgium, with internships during Year 6), using a 14‐station OSCE assessing basic clinical skills. Global ratings were used to score performance. The relationship between internship experience and the OSCE Year 7 score was analysed using a linear regression model, controlling for variation in OSCE scores from Year 5. A multi‐level analysis was performed considering students as level‐1 units and stations as level‐2 units. Results Year 7 OSCE scores (post‐internships) were not affected by the number of times that students practised basic medical skills during their internships. Discussion Scores on OSCEs do not seem to reflect clinical expertise acquired during internships. Other more integrated assessment methods may prove to be more valid for testing final undergraduate skills levels.  相似文献   

9.
OBJECTIVE: To explore attitudes among National Health Service consultants responsible for delivering basic clinical teaching to medical students. DESIGN: Postal questionnaire. SUBJECTS AND SETTING: A total of 308 acute hospital trust consultants working in 4 'new' and 4 'established' teaching hospitals in the West Midlands metropolitan area, and involved in the delivery of clinical teaching to Year 3 medical students at the University of Birmingham Medical School during 2002-03. MAIN OUTCOME MEASURE(S): The questionnaire explored contractual requirements, actual teaching commitments and perceptions of medical students' knowledge and attitudes. Responses from doctors and surgeons and from respondents working in established and new teaching hospitals were compared. RESULTS: A total of 249 responses were received (response rate 80.8%). Although many consultants enjoy teaching students, their enjoyment and their ability to deliver high standards of teaching are compromised by time and resource constraints. For many the situation is aggravated by the perceived inappropriate organisation of the clinical teaching curriculum and the inadequate preparation of students for clinical practice. Linking these themes is the overarching perception among teachers that neither service nor educational establishments afford teaching the levels of recognition and reward associated with clinical work or research. CONCLUSION: To overcome barriers to teaching requires more reciprocal links between hospital staff and medical schools, opportunities for consultants to understand and to comment on curricular and timetable developments, and, perhaps most importantly, recognition (in contractual, financial, managerial and personal terms) of the importance of undergraduate teaching in the competing triad of service, research and education.  相似文献   

10.
CONTEXT: A substantial proportion of medical students enter their intern year without any basic skills experience. Lack of experience is a significant source of stress for many junior doctors. OBJECTIVES: To evaluate the effect of a basic procedural skills tutorial for Year 3 medical students on their competence in relevant skills at Year 5. SUBJECTS: The control group consisted of 93 medical students who completed Year 3 in 1996. The intervention group consisted of 92 medical students who completed Year 3 in 1997. The intervention group received a practical skills tutorial in Year 3; the control group did not. Both groups were assessed on their practical skills competence during Year 5. METHODS: A 3-hour practical tutorial on injection and suturing techniques was delivered to the intervention group. The effectiveness of the intervention was assessed by self-reported experience of giving injections, inserting sutures and sustaining needlestick injuries, and by teacher-rated competency in four basic procedural skills. RESULTS: Students who received the Year 3 tutorial were significantly more likely to record a satisfactory assessment for their performance in all four basic skills compared with students who did not receive the tutorial. They were less likely than controls to refuse invitations to give injections, but not invitations to insert a suture, during Years 4 and 5. CONCLUSIONS: A single session of formalised teaching in procedural skills in the early stages of a medical degree can have long-term effectiveness in basic skills competence and may increase students' confidence to practise their skills.  相似文献   

11.
OBJECTIVES: Attempts to validate peer evaluation and to incorporate it into the curriculum have met with mixed results. The purpose of this study was to assess the use of peer evaluations in a Year 1 case-based learning course. METHODS: As part of the formal grading process for the course, all faculty facilitators (n = 69 over 3 years) completed a 12-item evaluation form for each student at the conclusion of each case. As part of a course assignment, students (n = 415 over 3 years) completed brief evaluations of their peers based on 2 criteria: the overall quality of written reports, and participation in group discussion. In addition, students provided anonymous feedback in the written end-of-course evaluation about the peer evaluation process, and faculty were asked to comment during the wrap-up luncheon for small-group facilitators. RESULTS: Response rates for the 3 Year 1 medical student classes ranged from 95% to 99%. The average number of peer evaluations completed for each student was 4.6. The G coefficients for the rater-nested-within-person generalisability study were 0.52 for written reports and 0.60 for group participation; both were based on an average of 4-5 ratings. Correlation coefficients between peer and faculty evaluations in each of the 3 consecutive years of the course ranged from 0.46 to 0.63; all were statistically significant at P < 0.001. A correction for attenuation suggests that the true score correlation between faculty and peer measures is near 1.0. DISCUSSION: This study provides strong evidence that facilitator and peer ratings measure similar constructs and shows that, even among Year 1 medical students, peer evaluation can be conducted in a valid manner.  相似文献   

12.
PURPOSE: To evaluate the effect of a compulsory evidence-based medicine (EBM) seminar in critical appraisal skills and the overall acceptance of compulsory EBM seminars for Year 3 medical undergraduate students. METHODS: Small group seminars by peer teaching were conducted for up to 23 undergraduates. Knowledge and skills in EBM before and after the compulsory seminars were evaluated by 2 different sets of 20 questions. To apply knowledge, each undergraduate had to analyse an individual paper case using the principles of EBM. Undergraduates gave anonymous feedback using separate evaluation sheets at the end of the seminar. Main outcome variables were changes in knowledge and skills. RESULTS: A total of 132 Year 3 undergraduates at the University of Frankfurt participated in a compulsory EBM seminar during the academic half-year 2003/04 as part of their regular curriculum. Complete datasets were available for evaluation from 124 undergraduates (94%). The seminars led to an overall increase in knowledge (question paper score increase from 2.37 to 7.48, 99% CI 6.61-8.36, or 216%). Transfer of knowledge into a paper case scenario was generally good, with a mean score of 49.5 (SD 5.24) out of 55 points. Feedback indicated good overall acceptance of the seminars, with a median of 2 (score range from 1 = excellent to 6 = failed). CONCLUSION: Trained medical students are effective and well accepted EBM trainers in compulsory undergraduate seminars.  相似文献   

13.
14.
OBJECTIVES: To examine whether changing initial answers during a multiple-choice question (MCQ) test in medicine brings about better overall test results, as has been shown in other academic fields. METHODS: A total of 36 answer books from the German Second National Medical Board Examination, with 580 MCQs (where 1 answer out of 5 must be selected), were used for analysis. RESULTS: We confirmed that high-stakes MCQ test scores in medicine did indeed improve when students changed their answers once. Further changes of answers did not improve the scores. CONCLUSIONS: In written, high-stakes medical examinations, we recommend that students be encouraged, after further reflection, to change their answers in MCQ tests for questions for which they had previously had doubts about the answers.  相似文献   

15.
CONTEXT: Most studies on medical expertise research have focused on diagnostic performance, whereas patient management has been largely ignored. According to knowledge encapsulation theory, applying encapsulated knowledge is a characteristic of expert doctors' diagnostic reasoning, but it is unclear whether or not encapsulated knowledge also plays a prominent role when processing a clinical case with a management focus. METHODS: The participants were 40 medical students (20 in Year 4 and 20 in Year 6) and 20 expert doctors (internists). Participants were asked to study the cases with either a diagnostic (Dx) or a management (Mx) focus. Subsequently, participants were asked to write down what they remembered from the case. RESULTS: In both conditions, experts recalled fewer propositions and used more high-level inferences than medical students. Furthermore, they processed the cases faster and more accurately than medical students, but no significant difference between Mx and Dx conditions was found. Year 4 students also showed no significant differences in recall and processing speed between conditions. By contrast, Year 6 students recalled more in a Dx than in an Mx condition, but there was no significant difference in processing speed between conditions. CONCLUSIONS: In both conditions, findings indicate that the experts' and Year 4 students' performance was not affected by processing focus. The fact that only Year 6 students were affected by processing focus might be explained by the assumption that their diagnostic knowledge and management knowledge are not fully integrated yet, a process that has already taken place in the expert's knowledge structure.  相似文献   

16.
CONTEXT: In 2003 the Dutch Central College of Medical Specialties presented guidelines for the modernisation of all medical specialty training programmes in the Netherlands. These guidelines are based to a large extent on the CanMEDS (Canadian Medical Education Directives for Specialists) 2000 model, which defines 7 roles for medical specialists. This model was adjusted to the Dutch situation. The roles were converted to 7 fields of competency: Medical Performance; Communication; Collaboration; Knowledge and Science; Community Performance; Management, and Professionalism. OBJECTIVE: As changes in postgraduate training will probably be most effective if future trainees recognise their value, we set out to determine how senior medical students rated these fields of competency in terms of their importance. METHODS: We carried out a study at University Medical Centre (UMC) Utrecht, the Netherlands, in which 80 Year 6 medical students answered a questionnaire in which they rated the importance of each of 28 key competencies within the 7 competency fields. RESULTS: Although all key competencies were regarded as important (averages > or = 3.8), Professionalism and Communication scored highest on the student ratings. Management was assessed as least important. CONCLUSIONS: It is interesting that medical students acknowledged the importance of competencies other than those involving medical expertise and performance. It confirms the opinion that educating doctors is currently viewed as much more than providing theoretical and clinical knowledge and skills. The CanMEDS framework is appreciated by Dutch medical students. The fact that all competencies are seen as important adds to their face validity and therefore to their usefulness as a basis for postgraduate training.  相似文献   

17.
OBJECTIVE: This study aimed to monitor which undergraduate students collected formative feedback on their degree essays and to quantify any correlations between gender or summative mark achieved and whether formative feedback was sought. METHODS: We carried out a study at the University of Aberdeen Medical School, involving a total of 360 Year 3 students, comprising all 177 students in the 2004 cohort and 183 in 2005. Data on gender and summative mark were routinely collected during the degree assessment processes in March 2004 and 2005. Students signed on receipt of their feedback. RESULTS: Less than half the students (46%) collected their formative feedback: 47% in 2004, and 45% in 2005. Overall, females were significantly more likely than males to seek formative feedback (P = 0.004). Higher achievers were significantly more likely than lower achievers to seek their feedback (P = 0.020). CONCLUSIONS: Our findings indicate that these medical students, particularly males and poor students, may not use assessment feedback as a learning experience. Female and better students are keener to seek out formative feedback that might be expected to help them continue to do well. We need to explore further why so many students do not access formative feedback, and develop strategies for addressing this issue effectively.  相似文献   

18.
CONTEXT: Self-assessment promotes reflective practice, helps students identify gaps in their learning and is used in curricular evaluations. Currently, there is a dearth of validated self-assessment tools in rheumatology. We present a new musculoskeletal self-assessment tool (MSAT) that allows students to assess their confidence in their skills in and knowledge of knee and shoulder examination. OBJECTIVES: We aimed to validate the 15-item MSAT, addressing its construct validity, internal consistency, responsiveness, repeatability and relationship with competence. METHODS: Participants were 241 Year 3 students in Newcastle upon Tyne and 113 Year 3 students at University College London, who were starting their musculoskeletal skills placement. Factor analysis explored the construct validity of the MSAT; Cronbach's alpha assessed its internal consistency; standardised response mean (SRM) evaluated its responsiveness, and test-retest, before and after a pathology lecture, assessed its repeatability. Its relationship with competence was explored by evaluating its correlation with shoulder and knee objective structured clinical examinations (OSCEs). Results The MSAT was valid in distinguishing the 5 domains it intended to measure: clinical examination of the knee; clinical examination of the shoulder; clinical anatomy of the knee and shoulder; history taking, and generic musculoskeletal anatomical and clinical terms. It was internally consistent (alpha = 0.93), responsive (SRM 0.6 in Newcastle and 2.2 in London) and repeatable (intraclass correlation coefficient 0.97). Correlations between MSAT scores and OSCE scores were weak (r < 0.2). CONCLUSIONS: The MSAT has strong psychometric properties, thereby offering a valid approach to evaluating the self-assessment of confidence in examination skills by students. Confidence does not necessarily reflect competence; future research should clarify what underpins confidence.  相似文献   

19.
OBJECTIVE: To describe the effects of a voluntary intervention using reflective learning techniques on students' learning. DESIGN: An interventional study with reflective learning techniques offered to medical students. SETTING: Year 3 of undergraduate medicine at Cardiff University where the curriculum is integrated with early clinical contact. PARTICIPANTS: All 232 Year 3 students were invited to participate. A total of 65 attended an introductory lecture. After the lecture 35 students agreed to take part; 15 of these subsequently dropped out (some before attending tutorial groups, others after taking part for some weeks). INTERVENTIONS: Participants kept learning journals for 2 terms and attended fortnightly, facilitated tutorial groups where they discussed their reflective journal entries. Main outcome measures were qualitative interviews and examination results. RESULTS: Interviews were carried out with 19 full participants, 4 initial participants and 7 non-participants. Participants perceived that they gained a greater ability to identify learning objectives and to integrate learning. The tutorial groups encouraged students to compare progress with their peers. Some students did not take part because they thought that the large factual content of the curriculum would make reflective learning less useful. There were no differences between the groups in examination results. CONCLUSIONS: Students among the small, self-selected group of participants were better able to identify what they needed to learn although there was no improvement in examination results. Students appear unlikely to take up voluntary reflective learning if they do not think it relates to the curriculum and assessments. Student culture exerts a potent effect on willingness to attend extra tutorial groups.  相似文献   

20.
Objective To describe and discuss Year 5 medical students' perceptions of their own learning about the doctor?patient relationship. Methods We carried out a qualitative study of semi‐structured interviews with 16 Year 5 medical students using 3‐way analysis at the School of Medicine, Federal University of São Paulo, São Paulo, Brazil. Results For experiences at the pre‐clinical stage, the subcategories were: positive aspects of the medical psychology course; great distance between theory and reality, and strong desire for clinical practice. For experiences at the clinical stage, the subcategories were: demand for opportunities to discuss the doctor?patient relationship; teachers as either role models or anti‐models; clinical situations favourable for developing empathic relationships, and clinical situations unfavourable for developing empathic relationships. For views about future experiences, the subcategories were: apprehension about ethical behaviour; anxiety about handling patients' psychosocial characteristics, and fear of professional ethics cases or legal action. Discussion To compensate for the lack of practical activities during the pre‐clinical stage, students search for extracurricular activities that often overload them. Because teachers function as professional role models, their attitudes towards patients have great importance. Students fear not being able to maintain their empathic capacity in the future because of work‐related issues. Knowledge of the psychological aspects of the doctor?patient relationship helps students to comprehend their experiences. Gradual contact between student and medical practice from the beginning of the course is advised. It should be followed by interdisciplinary discussions that deal with the technical aspects of cases and the doctor?patient relationship.  相似文献   

设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号