CONFERENCE EVALUATION

Participants were asked at the end of the conference to complete an evaluation form giving their appraisal of the programs and materials presented at the conference as well as their valuation of the experience. This information was solicited to enable the conference organizers to evaluate the conference and respond to participant needs and interests when planning future activities.

Of the evaluation forms distributed, 88.5 percent (177 out of 200) were completed and returned. The regional distribution of the respondents was roughly the same as the regional distribution of the conference (table 1) which makes this evaluation a fair representation of the participants’ views. Tables 2 and 3 categorize the respondents by organization type and area of expertise. Eighteen percent of the respondents had attended prior conferences in this series.

Table 1. Regional Response to the Evaluation

 

Respondents

Participants

Region

No.

%

No.

%

Asia and the Pacific

46

26

55

27

Africa

19

11

20

10

Central and Eastern Europe

18

10

18

9

Middle East

7

4

8

4

Western Europe

28

16

30

15

North America

22

12

25

12

Central America/Caribbean

8

5

10

5

South America

11

6

13

7

International

18

10

21

11

Total

177 100 200 100

Table 2. Organizational Type

 

Respondents

Type

No.

%

International

14

8

National

100

56

State/Province

35

20

Municipal

5

3

Nongovernment

14

8

Industry

1

1

Other

6

3

Unspecified

2

1

Total

177 100

 

Table 3. Area of Expertise

 

Respondents

Area

No.

%

Legal

63

36

Technical

43

24

Policy/Management

57

32

Other

5

3

Unspecified

9

5

Total

177 100

1 GENERAL COMMENTS

There was general praise for the conference among the respondents. Many found it informative, well organized and stated that the subject matter was well handled (57 respondents*). Others found it a valuable forum for exchanging information, expanding their perspectives and networking on a regional and international level (36). The wide diversity of participating countries was remarked upon frequently. Many respondents (16) commented on the benefits derived from such a diverse group and others suggested that more sessions be structured for regional or like groupings to facilitate discussion(18). Still others brought out the need to be increasingly sensitive to different orientations between developed and developing countries(8). Respondents praised the wealth of information presented, the quality of the materials and the caliber of the participants. It was suggested that future conferences place additional emphasis on presenting specific environmental problems, new strategies and practical tried solutions. Many respondents suggested that the workshop sessions be less structured and present more time for participant exchange and discussion. All respondents supported the idea of a fifth conference.

2 CONFERENCE PURPOSE AND GOALS

The participants were asked to evaluate the appropriateness of the Conference purpose and goals. A breakout of their responses is presented in figure 1. Seventy-one percent of the respondents (126) rated the purpose and goals very good to excellent. More specifically, some respondents (17) considered the conference a success of significant value and others (16) commented on the benefits of the range of participant experience and the opportunity for transfer of knowledge. Other respondents (7) suggested that there were differences between developed and developing countries, and between regions and one felt that diversity made specialized, in depth discussions harder.

Appropriateness of the Conference Purpose and Goals

Promote importance and underscore driving forces of environmental compliance and enforcement Foster institutional capacity to enhance existing and develop new environmental and enforcement programs Serve all stakeholders influencing the design of environmental compliance and enforcement programs Encourage ongoing international exchange and regional networking Foster exchange of expertise and learning through active participation

Figure 1. This figure shows the overall percentage ratings given by respondents who evaluated the appropriateness of the conference purpose and goals

The participants were asked how they felt about the conference’s focus on the development of domestic compliance and enforcement programs. Sixty-six percent (117) felt it was very good to excellent. Respondents wrote that this subject matter, theme and focus was well handled (12), it provided a good forum for exchange of information and experiences (13), and it was particularly helpful for developing programs (8). Some respondents (3), commenting on the size and depth of the subject, suggested that compliance and enforcement be treated separately, but the majority of respondents felt the emphasis as presented was successful.

3 SUCCESS IN ACHIEVING GOALS

Sixty-five percent of participants (115) who responded to the evaluation question concerning the conference’s success in achieving its stated purpose gave a rating of very good to excellent. A breakout of the responses is shown in Figure 2. Both the appropriateness and successful achievement of goals relating to the exchange of experience, learning and networking were consistently rated higher than those relating to capacity building and more theoretical exercises. This perception was reflected in various forms and answers throughout the evaluation.

Success in Achieving Conference Purposes

image3.gif (14476 bytes)
Promote importance and underscore driving forces of environmental compliance and enforcement Foster institutional capacity to enhance existing and develop new environmental and enforcement programs Serve all stakeholders influencing the design of environmental compliance and enforcement programs Encourage ongoing international exchange and regional networking Foster exchange of expertise and learning through active participation

Figure 2. This figure shows the overall percentage ratings given by respondents who evaluated the success in achieving Conference purposes

4 CONFERENCE PARTICIPATION

Seventy-one percent of the respondents (125) rated the number of conference participants and the mix of countries, organizations and experience very good to excellent. Figure 3 represents a breakout of the responses. A number of respondents (10) suggest increasing the number of participating countries and others (22) suggested expanding the nongovernmental and private sector representation. Comments relating to the mix of expertise included the suggestion that there be more enforcement agency participation and fewer representatives from the policy and law disciplines(3), and that more representatives from each country attend so that different sectors within the country could be present (2).

Conference Participation

image4.gif (13558 bytes)
Number of participents Countries represented Organizations represented Mix of expertise

Figure 3. This figure shows the overall percentage ratings given by respondents who evaluated Conference participation

5 STRUCTURE OF CONFERENCE

Fifty-eight percent of those who responded (103) to the question concerning the structure of the Conference gave a rating of very good to excellent. A breakout of responses is shown in Figure 4. Generally respondents found the plenary sessions and workshops useful and informative. Several commented that the sessions covered a lot in the given time and would benefit from a more limited but more detailed approach (16) and some commented that the topic were well handled but would benefit from shorted presentations and more discussion time. A number of respondents advocated more emphasis on the exhibits (9) increasing the countries represented, the materials, and the technology displays with technical staff in attendance (12). Additionally, several participants felt the program was very full and intensive and suggested some time ne scheduled for informal meetings and networking (4).

Conference Structure

image5.gif (15014 bytes)
Day One Plenary Session Day Two Principles of Environmental Compliance & Enforcement Workshops Day Three Regional Meetings UNEP Institution-Building Workshops Day Four Special Topics Workshops Day Five Regional Meetings and Plenary Closing Session Exhibits

Figure 4. This figure shows the overall percentage ratings given by respondents who evaluated the structure of the Conference

6 CONFERENCE TOPICS

Most participants agreed that the topics presented at the Conference were cohesive, well handled and covered a suitably broad range of interests and disciplines within the environmental enforcement community. Additional issues and topics that were recommended for future conferences included: economic incentives in compliance and how to address industry interests to involve them (5); criminal investigations and enforcement, penalty orders and illegal ocean dumping.(4); endangered species and wildlife sustainable utilization (3); and ISO 14000 (4). Several respondents recommended that more real life cases be presented and discussed and specific country or regional problems addressed(12). Many recommended that more emphasis be given to regional topics and issues including inter and inter- regional communication(16).

6.1 Day One and Day Five Conference Plenary Sessions

For each themes the evaluation included a question regarding the usefulness of the session’s theme content, the mix of topic addressed, and the opportunity for discussion. Figures 5 shows the range of ratings given for the Conference themes discussed on Day One and figure 6 shows the ratings for the theme presented during the Day Five plenary session. While the majority of the respondents found both the usefulness of the themes and the mix of topics to be quite good, numerous respondents (24) contended that the presentations attempted to cover too much and as a result were rushed. In relate comments some respondents recommended shorter presentations and more time for discussion during the plenary sessions(9).

Theme #1: Driving Forces Behind Environmental Compliance and Enforcement

image6.gif (9853 bytes)

Usefulness of theme contents

Mix of topic addressed

Theme # 2: Principles of Environmental Compliance and Enforcement (Plenary)

image7.gif (11456 bytes)
Usefulness of theme contents Mix of topic addressed Opportunity for discussion

Theme # 3: Establishing International Cooperation and Regional Networks: Status of Efforts Underway

image8.gif (11447 bytes)
Usefulness of theme contents Mix of topic addressed Opportunity for discussion

Theme # 4: International Capacity Building

image9.gif (11467 bytes)
Usefulness of theme contents Mix of topic addressed Opportunity for discussion

Figure 5. This figure shows the overall percentage ratings given by respondents who evaluated the Day One plenary themes

Theme 7: Making Progress: Regional Examples, Capacity-Building Agenda, International-Regional Networks

image10.gif (12707 bytes)
Usefulness of theme contents Mix of topics addressed Opportunity for discussion

Figure 6. This figure shows the overall percentage ratings given by respondents who evaluated the Day five plenary theme

6.2 Day Two workshops on Principles of Environmental Enforcement

Eleven workshops were presented on Day Two using seven case studies. Three of the studies were presented in more than one session because of the number of participants interested in those cases. The participants were asked to evaluate each workshop according to the following criteria: Ability to apply principles of environmental enforcement in a realistic setting; quality of the workshop materials; usefulness of contents and usefulness of the technical support package. Table 4 shows the evaluation for each case study. Most respondents found the format of these workshops to be valuable for exploring the principles of environmental enforcement. Although comments varied by workshop and session, there were several observations that were made by respondents from all workshops. A number of respondents (20) commented that the studies were too compressed and too much to handle in one day and others recommended that the facilitated presentation not be as structured and allow more time for discussion and sharing of experiences (14). An additional suggestion was made that the workshops were more beneficial to participants who were attending these conferences for the first time(5).

6.3 Day Three Regional Workshops and Institution building (UNEP)

Seven regional meetings were held on Day Three and continued on Day Five. Many respondents felt that these were the most valuable sessions of the conference. Comments on the meetings varied by region. In several of the meetings, a number of the respondents felt initially that the goals were unclear (17) but as the meeting progressed many respondents reported that the discussions were very good and informative (22 ). Also, several respondents reported that the setting and format of the meetings were somewhat restricting (31) but that the participants were able to set a more workable framework and the discussions became successful. Other respondents noted that some of the regions had already established networks while others were just beginning the process and so suggested that the formats and discussions be tailored to the individual region (8). Numerous respondents recommended that the efforts started in the meetings be continued and regional meetings or other networking activities be undertaken before the next Conference (25).

Table 4

Respondents reported that in several meetings the lack of time prevented the inclusion of the UNEP workshops within the regional meetings, however those who did attend the workshops reported favorable reactions. Some respondents commented that, as in the case of the Principles of Environmental Enforcement workshops, these workshops were more beneficial to participants attending the conference for the first time. Figure 7 represents the ratings of those who evaluated the UNEP workshops.

UNEP Workshop - Institution Building

image11.gif (15325 bytes)
Usefulness of contents Mix of topic discussed Opportunity for discussion Quality of materials Usefulness of contents Usefulness of manual

Figure 7. This figure shows the overall percentage ratings given by respondents who evaluated the UNEP workshops

6.4 Day Four Special Topic Workshops

Fourteen Special Topic workshops were presented in two sessions on Day Four. Many respondents who completed this section of the evaluation form noted that the workshops were valuable and discussions were good (12). Figure 8 shows the overall percentage ratings for "very good" to "excellent" given by respondents who evaluated the Workshops. Table 5 gives a breakout of the responses by workshop. Some respondents found the session very good and well directed, while others felt the facilitators could have been more responsive to the individuals in the workshops. Several participants, commenting on the short duration of the workshops suggested that materials could be prepared and handed out in advance (9). Additional comments included the recommendation that the workshops be less general and address more concrete examples (7) and the observation that the diversity of experience and regional make-up of the workshop participants impacted the flow of the workshop and more depth could be achieved with a more homogeneous group (8).

Special Topic Workshops

image12.gif (23467 bytes)
B C D E F G H I J L M N Q R

Figure 8. This figure shows the overall percentage ratings for "very good" to "excellent" given by the respondents who evaluated the Special Topic Workshops

Table 5. Special Topic Workshops

7 TECHNICAL AND CAPACITY BUILDING SUPPORT DOCUMENTS

The participants were asked to evaluate the technical and capacity building support documents that had been prepared for this series of conferences. Figure 9 represents the overall ratings of those respondents who evaluated these documents. A number of respondents suggested that the approach presented in the documents favored the Western countries (4). Others felt the documents were valuable and stressed the need for their dissemination (3).

Technical & Capacity Building Support Documents

image13.gif (15167 bytes)
Source self-monitoring requirements Multi-media inspection protocols Organizing environmental permit, compliance and enforcement programs Financing environmental permit, compliance and enforcement programs Communications strategies for enforcement Transboundary trade in potentially hazardous substances

Figure 9. This figure shows the overall percentage ratings given by respondents who evaluated the technical & capacity support documents

8 EXHIBITS

The participants were asked to evaluate the displays and exhibits provided at the conference. These included computer exhibits, databanks, videos, and regional country information. Numerous participants felt that the exhibits were both informative and interesting, and they provided a good exchange of information (90). Fifty-six respondents commented favorably about the computer display and forty-four commented favorably about the videos. Seventy-three respondents praised the country information. Some respondents felt that the exhibits were dominated by Europe and the US (8) and others and suggested that efforts be made to solicit displays from a greater number of countries. Another suggestion (6) was to assign a staff person to man the exhibits (6) and answer questions.

9 ORGANIZATION OF THE CONFERENCE

The majority of the respondents lauded the efforts of the Conference staff, calling the conference extremely well organized (33) and in some cases the best of this size they had attended. The respondents were very pleased with the accommodations and enjoyed the location, cultural events, and the food. Respondents also commented that the program was very intense and would have benefited from an afternoon off for sightseeing, networking or relaxation (18). Additional comments included the recommendation that there be more contact with the Executive Planning Committee and staff (3) and that E-mail access be available (1).

Logistics

image14.gif (17170 bytes)
Accommodations Location Schedule Service desk Special events Food and beverages Contact with executive planning committee Availability of conference staff

Figure 10. This figure shows the overall percentage ratings given by respondents who evaluated the organization of the Conference

10 FOLLOW-UP TO THE CONFERENCE

All participants that responded to the evaluation supported the idea of a fifth conference. Forty-one respondents suggested holding the next conference in the United States, thirty-three suggested Africa, and eight suggested South or Central America. There was a mixed response about when to hold it, and most respondents realized that it would depend on the venue. However, forty-six specifically requested the spring; thirteen, the fall; and fourteen, the summer.

There were several specific requests for subjects to be covered at the next Conference. These included:

Other suggestions for future conferences were more general. These included the following: