We have been so process-driven as an organized Jewish community that we have not demanded more in terms of outcomes.
by Dr. Misha Galperin and Dr. Aviva Zubida Zeltzer
We very much appreciated Jon Levisohn’s recent reflections in eJewishPhilanthropy on rethinking Jewish identity. These came out of a conference on Jewish identity and education and the concern that he expressed about the way the Jewish community talks – or does not talk – about notions of Jewish identity and assumptions that get made about it in the world of education. Levisohn posits that some scholars don’t discuss identity at all, or as much as we should, because it is too hard to measure. Although he offers a number of other reasons, I would like to share our thoughts on how we measure Jewish identity, at least how we are planning to measure it here at The Jewish Agency, where identity building is a core and foundational aspect of our shared work.
Identity is largely about self-understanding: who I think I am in the world, and the narrative that I have created about myself.
But when it comes to collective identity, self-understanding becomes much more complex because the “self” in question is diverse, contradictory, immense, deep and old. Who can claim to shape that identity? Levisohn asks: “If Jewish education is not about strengthening Jewish identity, then what it is about? How can we articulate the desired outcomes of Jewish educational projects and programs without resorting to claims about identity?”
These are fair and important questions that make us more convinced than ever that we need to create some shared language around measurement and assessment. For that, we put on the hats of a clinical psychologist and a sociologist, our professions before joining the world of Jewish communal service. Identity, in our professional understanding, is about the affective, behavioral and cognitive aspects of self (the ABC’s) that together constitute human life. In other words, how we feel, how we act and what we think and know forms our core categories that make up the understanding of selfhood. These are difficult things to measure, but not impossible.
After a process of consultations with researches, practitioners and funders in the world of building Jewish identity over the past two years, we developed an impact matrix utilizing these three foundational aspects of self and we would like to share the prism or lens by which Jewish identity in this construct is devised and then evaluated. We wanted to understand Jewish commitment through one’s attitudes and relationship to Israel, to Jewish heritage, to the Jewish community and to Jewish peoplehood – the values underlying our mission and our programs. We felt that all were central to Jewish self-definition and some, naturally, would be more prominent in the thinking and behavior than others. For example, many see their Jewish identity wrapped up in Israel but care little for their local Jewish community. Others see their identity measure in ritual observance but not in feelings about peoplehood.
When we create programs, we need to evaluate their impact in terms of affect, behavior and cognition. We might survey participants in long and short-term immersive experience and ask – after an Israel program, let’s say, “Do you feel more connected to Israel and Israelis? Do you have a personal opinion about the situation in Israel? Behaviorally, we want to know if you follow news about Israel or participate in Israel-related events? Would you visit Israel again or give to a cause that supports Israel? On the cognition front, we might inquire if someone is more curious or has researched Israel history and society, culture or ways to get involved with Israel.
The same might be true on the Jewish community front. Emotionally, does this program/offering help individuals become more personally invested in the community and have an opinion about its current and future direction? Having an opinion shows a new level of ownership that is qualitatively different from mere participation. And that’s what matters in this “business” – moving people from one level of commitment and cognition to the next. Are we doing that? Not intentionally enough, we believe.
Levisohn asks: “So next time you hear someone using the term, ask yourself: What do they mean by it?” We know what we mean by it at The Jewish Agency, and it’s not a passing phrase that we give lip service to. We have invested too much money and too many years to leave evaluation up to chance. It is time that we all start measuring the impact of what we do in more concrete terms. Are we moving people? Are we changing them? If not, why not? If so, how?
We have been so process-driven as an organized Jewish community that we have not demanded more in terms of outcomes. Outcomes depend on understanding the impact of our work. It’s time. And for my next question I turn back in time to the great sage Hillel: If not now, when?
Misha Galperin is the President and CEO of International Development at The Jewish Agency.
Aviva Zeltzer-Zubida is Chief Strategy Officer at The Jewish Agency.
Warren Hoffman says
June 16, 2014 at 5:19 pmSo, while measuring for impact is of course good and necessary, as a professional in the programming world who has to do deal evaluations on a regular basis, I find a lot of these questions untenable. To attend a single Israel program and then ask “Did this program connect you to Israel?” or to attend a single Jewish cultural event (a film, a movie, a lecture, etc.) and then ask “Did this event make you feel more Jewish?” or “Did this event strengthen your Jewish identity?” is tenuous. To me it’s like serving someone a salad and then asking them, “Did this salad make you consider becoming a vegetarian ?” Ridiculous, right? The danger with such evaluative questions is that because people doesn’t always answer in the affirmative or have a “Come to Moses” moment after a single event, it could skew the event and make it look like it was a failure. Rather, and this is the frustrating truth, but change happens in pieces overtime. If we as a Jewish community could ask broader, more long-range questions such as, “Tell us what activities or events have contributed to your Jewish identity in the last year, five years, etc.” I think we would have a fuller picture of how programming effects impact.
We as funders (and programmers) need evaluation and we need to measure impact. We need to be careful not to lean so strongly on the short-term one-off successes that can distract from the long-term investment we need to make in the community for true payoffs. Our work in this field (as other have said) is a marathon, not a sprint.
Warren Hoffman
Associate Director of Community Programming
Center for Jewish Life and Learning
Jewish Federation of Greater Philadelphia
Sara Shalva says
June 18, 2014 at 4:19 pmLast week I participated in a strategic conversation with MASA Israel. As a 3 time alum of long term programs in Israel (HU, Otzma and Pardes), and as a Jewish professional who left the field this year to pursue work in another industry, I feel invested in this conversation more personally than professionally at this point. The programs in Israel I participated in before the advent of MASA changed the course of my life, and I hope more and more young people will go to Israel to have similar experiences.
At the strategy conversation, Liran Avisar, the new CEO of MASA, presented the results of the recent study on the MASA participants that focused on identity and seemed to use the measurements laid out in the article above. The key takeaway from that study was the fact that the participants felt much closer to Israel and Israelis and yet no real increase in their connection to Jewish community at the conclusion of their programs. This makes we wonder if we are asking the right questions of the participants.
When we define Jewish community we tend to use fairly traditional concepts including institutions that aren’t particularly meaningful to millennials. When thinking about a Jewish identity matrix, I think it is important to think about the population we are measuring and in particular, when we look at measuring the behavior of the millennials we need to think creatively about their connections to the Jewish community and about possibly expanding our conceptions of those behavioral connections so we can get an accurate reading of their identity and understand any changes after the programs.
I also think Jon Levisohn’s article is important because it asks us, on some level, to examine the concept of identity–maybe that isn’t what we should be measuring–or maybe we should be measuring identity differently. How do we rethink Jewish education and educational outcomes if we redefine identity? Because our understanding of identity is complex, our desired outcomes have to match that complexity. Maybe we want the long term participants to have more agency in their Jewishness, and become more proactive in their Jewish decision making, and be more sophisticated in their understanding of serious Jewish content, speak, comprehend and read more Hebrew– so then how do we measure those things? Can they be captured by the affective, behavioral and cognitive matrix and if not, how could we change the matrix to include what might be subtle, complex and at times hypocritical realities in the identities of the participants? One example of this might be a conversation I had with an alum at the event. She said she had a tough time on her program, but fell in love with Israel and Israelis. “I would never date an American Jew. I have to end up with an Israeli if I am going to marrying someone Jewish.” How is that sentiment captured in a Jewish identity study? And would it be defined as a success?