Oakland Unified School District

Urban Dreams Technology Challenge Grant

Project Description and Evaluation Plan 

Prepared by Center for Evaluation and Research, LLC

MENU

 

Part 1

 
Project Map Project Narrative Inputs/Processes/Outputs (IPO)

 

Discrepancy Evaluation Model (DEM) Evaluation IPOs  
Management Component
Management Narrative Management Tasks Management Equipment Site Physical Needs Hardware Partners

 

Student Achievement Component

 

Student Achievement Narrative Objective 1: Language Arts and Social Studies Objective 2: Technology Systems

 

Professional Development

 

Professional Development Narrative Technology Embedded Curriculum Staff Development Management Tasks Participating Teacher Training Content Tasks
Summer Institute Component Curriculum Development  Technology Integration Current Awareness of Standards Tech Tools and New Curriculum Partner Projects

 

 

Community/Parent Component

 

Parent Community Narrative Parent Involvement and Community Engagement The Parent University Equipment Dispersed
  Access to Technology  
Part II Planning - 2001-2002
Student Achievement Professional Development Technology Access and Parent Involvement
  Logic Model  

 

PART I

Program Description

Project Map

  

Project Narrative

Urban Dreams, a federally funded Technology Innovation Challenge Grant, under the thematic umbrella of human and civil rights seeks to:

Improve student achievement in language arts and social studies classes for OUSD students enrolled in grades 9-12

Develop student historical thinking skills in a technologically supported context

Improve student expository writing skills in a technologically supported context

Provide the necessary professional development to ensure that curriculum embedded technology strategies, techniques, lesson plans and best practices are conveyed to teachers

Provide content enrichment through on-line and off-line activities

Provide classrooms with access to hardware, software and other technology tools chosen to support the OUSD, state and national content standards

Strengthen the home-school connection

Provide student and parental access to computers at home through a community service and training program

These goals will be accomplished through providing students, teachers and community with new tools, strategies and techniques.  

 

Discrepancy Evaluation Model (DEM)

Overall Project Inputs/Process/Output (IPO)

Inputs

Process

Target Output

Resources provided by U.S. Department of Education, OUSD and Project Partners

 

Development and implementation of innovative technology strategies, enhanced content and increased use of computers in schools and homes

 

Significant gains in student achievement in Language Arts and Social Studies for OUSD high school students


Project IPO - Evaluation

Inputs

Process

Target Outputs

Financial, Physical and Equipment Resources:

Resources Provided by U.S. Department of Education awarded a five-year Technology Innovation Challenge Grant  (TICG)

Resources provided by OUSD

Resources provided by Partners

Human Resources:

Project Leader

UD Project Staff

CER Evaluation Team

Curriculum and Instruction Staff

Project Partners

OUSD Research and Technology Departments

Participating Teachers (PT)

Students

Parents

Other:

Guidelines, rules and regulations from the United States Department of Education Federal Technology Innovation Challenge Grant

The DEM plan is created by Urban Dreams (UD) project staff and the Center for Evaluation and Research (CER) evaluation team.  It includes program narratives, component maps and input, process, and output (IPO) statements for each of the four program components (Management, Professional Development, Technology Community Involvement, and Parent Involvement) on increasingly detailed levels. 

The plan is updated to reflect not only original resources, goals (outputs) and processes, but will reflect discrepancies in intended outputs and elaborate on the nature of  those discrepancies and other formative data contributing to project staff  decisions for change grounded in that data.  This method of evaluation provides a line of information that shows original intents and explains changes based on formative data, which serendipitously helps in creating an accurate audit trail for the evaluation.

The DEM plan enables stakeholders to examine in detail the original intent of the project as well as the path it is taking (including documentation  of all evaluation activities, data analysis and reports on project) though the five years of implementation to reach the identified goals.

 

 

 

 

Web site maintained for project information and evaluation activities.

 

 


 

Management Component

Management Narrative

The goals of UD management are to facilitate effective implementation of the other components of the grant. Sites, students, teachers and parents will have the necessary instructional media, resources, equipment, and training to meet the overall goals of the grant.

Qualified personnel and consultants will be located and hired to implement the grant program.

Assessment of the infrastructure needs such as wiring and electrical requirements will be conducted in conjunction with the appropriate OUSD departments and improvements arranged if needed. Equipment needs will be assessed and the best solution for each classroom will be researched, engineered and installed.

UD staff and partners will collaboratively analyze issues around scheduling, projects planning, resource development and professional development issues. The necessary contracts for each partner organization and various vendors will be written and approved by the various oversight organizations within OUSD. OUSD staff will be responsible for overall project management.

Professional development will be planned and organized by UD staff in collaboration with project partners and the Teacher Leaders who work with each project. Resources, on and off-line, will be developed that support the goals of the grant and reflect the innovative characteristics of the grant proposal.

Evaluation, both formative and summative, will be contracted to an outside provider and facilitated by the UD management team.  A variety of evaluation techniques will be used and documented.  Meetings will be regularly scheduled and grant planning will be informed by the results of the evaluation.

Approximately 50 teachers per year will receive equipment and participate in professional development activities.

Management Component – Urban Dreams

Management Tasks

Inputs

Process

Process Status

Outputs

Outputs Status

Project Leader

UD Staff

Curriculum and Inst. staff

Appropriate Project partners

 

 

 

P0.1 UD Staff and consultants are selected, processes and contracted

Accomplished

O 0.1 Two TSAs, and clerical support in place, contracts signed and approved by board for consultants, contracts and memos of understanding written for partners.

Accomplished

P0.2 Participating classrooms are visited to determine physical needs , i.e., tables, wiring, security,

Accomplished

O 0.2 Arrangements with other OUSD divisions made to do any necessary remediation so teachers and students have access to working equipment in a high expectation learning environment.

Accomplished

P0.3 Equipment and instructional media chosen by interviewing vendors, teachers, seeking out recommendations of the Tech Services dept. researching the equipment testing institute.

Accomplished

O0.3 Students and teachers and have access to instructional media of high quality that is cost efficient, effective and powerful.

 

Accomplished

P0.4 Contracts, scheduling and planning with partners is initiated and continues on an ongoing basis.

Ongoing

O0.4 All Partners and subsidiary projects are supporting grant goals

 

Ongoing – Evaluators to gather information concerning the extent to which partners are participating

P 0.5 Assessment and evaluation is planned, evaluators contracted for required evaluation of grant

Accomplished

O 0.5 Center for Evaluation and Research (CER) team in place

Accomplished

P 0.6 Other district initiatives and departments like C&I , Tech Services Digital High School, Chabot Techbridge, OTX, mentors, polled for parallel projects, community organizations are kept informed of progress of grant and grant activities by web pages and/or hard copy newsletter

We should include in staff interviews questions concerning how the initiative is coordinated with other district programs.

00.6 Efforts are coordinated, duplication of effort is minimized, maximum support generated.

Ongoing – this is a part of the annual interview of project staff

Equipment

Inputs

Process

Current Status

Outputs

Outputs Status

Project Leader

UD Staff

Curriculum and Inst. staff

Appropriate Project partners

 

 

P0.1.1 Project Manager selected

Accomplished

O 0.1.1 Implementation of the grant is managed.

Accomplished

P 0.1.2 Tech Integration TSA is selected

Accomplished

O 0.1.2 Site visits, coaching schedules established and implemented.

Accomplished

P 0.1.3 Clerk typist is selected

Accomplished

O 0.1 3 Ordering of equipment on OBARS, financial aspects of grant in place

Accomplished

P 0.1.4 Tech support team selected and put into place.

Accomplished

O 0.1.4 Roll out schedules, equipment benched and loaded

Accomplished

P 0.1.5 Consultants are selected and put into place.

Accomplished

O 0.1.5 Coaching and inservice are conducted, starting with TL corps and continuing into UDSIs and throughout the school year.

Accomplished

To what extent are teachers using technology in their classrooms?

Site Physical Needs

Inputs

Process

Current Status

Outputs

Outputs Status

Project Leader

UD Staff

Curriculum and Inst. staff

Appropriate Project partners

 

 

 

 

 

P0.2.1 District and UD staff collaborate to establish most effective physical setup of hardware, software

Ongoing

O 0.2.1 Students and teachers have effective tools with which to improve LA and SS achievement

Annual question of teachers on the effectives of the tech tools are and their impact.

P 0.2.2 School sites are visited to determine which rooms are wired and if not how to move teachers into rooms that are wired.

Facilities and Site notified of necessary remediation measures.

Ongoing

O 0.2.2 Every participating teacher and their students has an Internet connection to be able to do investigative research projects

Ask staff and teachers about Internet access by all students.

P 0.2.3 Furniture needs and security is arranged.

Facilities and Site notified of necessary remediation measures.

Ongoing

O 0.2 3 Equipment is for students and teachers to have access to instructional media necessary to achieve grant goals.

We need a thorough description of the current status of technology in the schools and what it would take (teachers, staff) opinions to make technology more accessible.

Management (purchase of equip, scheduling etc. - Do teachers have the necessary hardware to complete grant activities?

Inputs

Process

Current Status

Outputs

Outputs Status

Project Leader

UD Staff

Curriculum and Inst. staff

Appropriate Project partners

 

 

P0.3.1 Classroom setups determined by a process of consulting reviews, recommendations of Tech Services, price points and purchased

Need specific information how classrooms were chosen and the extent to which they were setup

O 0.3.1 Teachers for pilots and teachers of Cohorts have necessary hardware to complete grant activities

Questionnaire: Who are teacher of pilots and cohorts?  Do they have the necessary hardware to complete grant activities?

P 0.3.2 Laptops for TLs determined by a process of consulting reviews, recommendations of Tech Services, price points and purchased.

Need more information on process

O 0.3.2 Equipment bought

How many and for whom?  How do teachers use the laptops?

P 0.3.3 TVs and VCRs determined by a process of consulting reviews, recommendations of Tech Services, price points and purchase.

Need more information on process

O 0.3 3 Equipment bought

How many and for whom?  How do teachers use the TVs and VCRs?

P 0.3.4 Misc. equipment like hubs, cables, limited spare parts are ordered.

Need more information on process

O 0.3.4 Equipment in place

Is the equipment in place in project classrooms?

Management contacts with partners

Inputs

Process

Current Status

Outputs

Outputs Status

Project Leader

UD Staff

Curriculum and Inst. staff

Appropriate Project partners

 

 

P0.4.1 Products and expectations for each partner developed in collaboration with partner, C&I staff and UD staff.

Need more information on process

O 0.4.1 Projects have clearly defined roles and products.

 

We need to gather information on project management and even the flow of information and decision making

P0.4.2 Participation in professional development is defined in collaboration with partner, C&I staff and UD staff.

How is UD professional development integrated with other district sponsored efforts?

O 0.4.2 Professional development with clear links to standards and with technology integration is delivered to each Cohort

Summer Institute evaluations using exit evaluation form

P 0.4.3 Any necessary materials and equipment for collaborative purposes is defined and delivered

Need more information on process

O 0.4 3 Teachers receive timely professional development and coaching by qualified experts.

Technology Workshop Evaluation Form

 

Student Achievement  

Student Achievement Narrative

 

The ultimate goal of all of the Urban Dreams is student achievement.  All of the project’s activities support this goal.  professional development program is to provide high school teachers of Language Arts and Social Studies and support staff with new strategies and techniques necessary to help high school students improve expository writing and historical thinking skills in the context of human and civil rights

The project is accomplishing all of the stated data collection activities including the administration, collection and analysis of district performance assessments and the SAT/9 (Objective 1.1).  All participating students are now identified and a database has been created that enables the project to track individual student’s SAT/9 scores (as Normal Curve Equivalents, or NCE), attendance, and other indicators.  Baseline data for both 1999-2000 and 2000-2001 have been recorded and analyzed for this narrative.  The project is working with the district to gather additional student data with the goal of creating a comparison group for data analysis purposes.  The project will also collect high school exams for the first time this year.

The evaluation group will continue to collect student work during its interviews with first and second cohort teachers.  Similarly, the evaluation group has developed a mockup of a student portfolio system that could be used by project staff and teachers.  Lastly, the new supplemental grant should produce extensive video footage of students actually working on technology infused activities.

The project is currently developing and will begin preliminary administration of a high school technology exit assessment.  It is envisioned the exam will measure the technology competencies of exiting students who have participated in the project.  These results will be compared to an equivalent comparison group. 

 

Objective 1: Language Arts and Social Studies: By June of 2002, Oakland high school graduates who have participated in the Technology Integration Program for three years will demonstrate statistically significant (p<.05) pre and posttest gains in district, state and national performance standards in social studies and language arts as prescribed by NESIC and the California Frameworks Committees, and/or as measured in district and state assessments, including but not limited to the state-prescribed standardized assessment (Stanford Achievement Test 9).

Evaluation Question:  To what extent, are students gaining technological proficiency?

Evaluation Question: To what extent, are students demonstrating academic achievement in language arts and social studies?

Inputs

Process

Current Status

Outputs

Outputs Status

UD Staff