Further thoughts about our presentation: 10th Networked Learning Conference 2016

This week Jutta Pauschenwein and I presented a paper Visualising Structure and Agency in a MOOC using the Footprints of Emergence Framework at the 10th Networked Learning Conference in Lancaster, UK. Here are the slides for our presentation.

On their own these slides do not make a lot of sense, so we have added notes, which you can see by going to the Slideshare and clicking on Notes. Or here is a PDF with the notes: NLC2016-slides-notes-mackness-pauschenwein

We were pleased that our session generated a few comments and questions. Helen Crump commented that she had used the Footprints Framework in the past and found it interesting. You can see Helen’s footprint here.

I don’t remember the exact questions we were asked at the end of our presentation, but there was some discussion about whether it is realistic to think you can get an alignment between the teacher’s design intentions for a course and the learners’ experiences. Jutta responded to this saying that she wasn’t trying to get an alignment, more to know where there is misalignment, so that she can adapt her course.

We were also asked whether it would be possible to use the Framework with large numbers as in MOOCs. In Jutta’s MOOC, 49 learners  (out of 460) voluntarily drew footprints, without any input other than a video. Normally we would recommend a one hour workshop as a minimum for introducing the Framework to new users. For a long time we have wanted to create an electronic version of the Footprint drawing tool, which would not only allow learners to draw and share them more easily, but would also collect written comments and reflections on the factors and automatically score the footprints for further analysis. For this paper we did this manually. So there is still plenty of scope for development, which is needed if we want to use the Framework with large numbers of users.

I don’t know if other paper authors do this, but I usually try and anticipate the questions we might get. This time, before the conference, I gave the paper to a friend asking for potential questions that might arise from the paper. Although these questions were not asked at the conference, I will share them here (and my answers) as I found them useful in preparation for our session. So here they are:

  1. What does structure and agency mean?

For our work ‘structure’ means how a learning design balances openness and structure and how this balance is implemented in relation to the interactivity it enables.

‘Agency’ means the extent to which learners are enabled to develop their capability for effective action on their own terms; how the environment enables them to explore, establish, network and present themselves, their ideas, aspirations and values through writing and presence.

  1. Why are structure and agency appropriate lenses to study learner experience and teacher/designer role?

Structure and agency are particularly appropriate lenses to study the learner experience and teacher/designer role in the context of MOOCs, because MOOCs are changing the shape of structure and agency in open online learning environments and these changes are beginning to affect more traditional learning environments – as we see in practices such as the flipped classroom. MOOCs are complex learning environments, in which the structure may be very loose/open and in which learners may have considerable autonomy. Ashwin (2012) has argued that research into teaching and learning interactions in Higher Education has consistently looked the interrelationship between structure and agency. He also argues that there has been a tendency in research to separate the learner experience from the teaching experience. Like him, we believe that a holistic view is needed to understand the learning experience in MOOCs.

  1. What is the relationship of structure and agency to the clusters in the footprints model?

In this paper we consider structure and agency in terms of the Footprints of Emergence Framework. The Framework takes a holistic view of learning in prescribed and open learning environments recognising the interrelationship between structure and agency and how they influence each other. In this framework 25 learning characteristics are organised into four clusters. Two of these clusters – open structure and interactive environment, relate to the design or structure of the learning environment, and two to learner agency.

  1. Did the MOOC participants really understand the footprints tool?

It is difficult to know this without interviewing them. Experience with the Footprints has shown that ideally users are introduced to the Footprints through a workshop and that when this is done, it doesn’t take long for people to understand how to use them and draw a Footprint. But the value of the footprints is in the depth of reflection that they can invoke if discussed. Interviews were not part of this research but will be for future research. One of the difficulties has been in translating the Footprint characteristics explanations into German. What we do know is that participants voluntarily drew and shared their footprints, learning how to do this by watching a video.

  1. How can you be sure that the cluster elements are as influential in shaping the learning experience as you claim given the importance of autonomy and self-determination of the learner?

The cluster elements are intended to reflect the learning experience, rather than shape them. They are based on our own experience of learning in open and prescribed environments and of our knowledge of educational research and educational theorists. When we designed the Footprints of Emergence Framework and worked on the factors, we considered them to be a palette. In other words, we did not say that they were the definitive list of characteristics that describe the learner experience. We offered them as a palette of characteristics which could be selected from or which could be replaced by other characteristics. Our experience has shown that these 25 factors provide a rich picture of the learning experience, but a designer using the footprints drawing tool is free to add or take out factors.

  1. Emergent learning is not predictable as you say and the participants were asked not to be too precise about positioning their responses when drawing footprints – doesn’t this make the footprints tool a very crude and approximate way of measuring the efficacy and effectiveness of the learner experience?

The Footprints of Emergence Framework is not intended to measure the efficacy and effectiveness of the learner experience. Principally it is intended as a tool for promoting deep reflection on the learning, design or teaching experience. But in our research we realised that if we scored the Footprints retrospectively and objectively, then it is possible to compare footprints and begin to explore the balance between structure and agency, prescription and emergence. Reflection is never a precise measure. 

  1. How much credence can we give to the scores given the observation in Q6?

As much credence as any evaluation tool. The factors were scored against a given range independently by each of us and then compared. We used a scale of 1-30 for the spectrum of prescribed learning to the edge of chaos. Any disparities (which were minimal) were discussed and then the final score agreed. The scores in themselves are not important. The patterns that the scores might reveal are of more interest. We are confident that the patterns that emerge through this process, can inform us about the balance between structure and agency, but do not see this as a precise measure. All we can say here is that the majority of MOOC participants had an emergent learning experience and that the MOOC design was successful in assuring a balance between structure and agency.

  1. Isn’t there a risk that given the sample who drew the footprints – largely students on a course run by one of the researchers – that the data was biased to how the students perceived the intentions of the researcher?

Yes and that is acknowledged in the research. What is needed is to interview the participants who drew footprints, and ideally these interviews would be carried out by a researcher not known to the participants. Past experience in earlier stages of the research when the drawing tool was used with individuals has shown that interviews are needed to ensure that the final footprint drawing is an accurate representation of the users’ experience. This research using the Footprints of Emergence Framework at scale is in its early stages. Future research will include interviews of participants.

Networked Learning Conference 2016 starts today

Tomorrow (Tuesday) Jutta Pauschenwein (@jupidu) and I will give a presentation at the Networked Learning Conference 2016 in Lancaster about the work we have done together using a visualisation tool, Footprints of Emergence, to try and understand more about how learners and course designers experience the relationship between structure and agency in a MOOC.

We have been working with the Footprints of Emergence framework for a number of years. The framework was developed in collaboration with Roy Williams and Simone Gumtau in 2012 and over succeeding years we have published papers and run workshops about it – even one at Lancaster University a few years ago.  I included references to our papers in my last post – Presenting at the 10th Networked Learning Conference, Lancaster.  Jutta has used the framework extensively with learners and teachers at her institution in Graz, Austria.

The Footprints of Emergence drawing tool requires users to reflect deeply on 25 characteristics of open learning environments (factors), which are organised into four clusters.

Screen Shot 2016-05-09 at 07.13.19

Learners consider how prescribed or emergent their experience was in relation to each of the factors and indicate this by placing a point on the relevant line on the template. This process results in a ‘footprint’.

Here are some examples of footprints which we have collected over the years on our open wiki – http://footprints-of-emergence.wikispaces.com/home

Screen Shot 2016-05-09 at 06.46.15

Footprints have been drawn not only by learners, but by teachers, designers and researchers, both for formal and informal learning experiences. Jutta, for example, has recently travelled extensively in Argentina and Chile and used the footprints to reflect on her emergent learning experience of travelling alone. See https://zmldidaktik.wordpress.com/2016/02/21/reflecting-emergent-traveling-experiences/

In this research Jutta used the Footprints of Emergence framework to help her design a MOOC – Competences of Global Collaboration –  and then asked the MOOC participants to draw footprints as part of the final evaluation process. Our paper has now been published on the Networked Learning site, as have all the papers. See http://www.networkedlearningconference.org.uk/abstracts/mackness.htm

Later this morning we will head over to Lancaster for the start of the conference at midday. Amazingly for this part of the world the sun is shining and there is not a cloud in the sky. Jutta and I have had a great weekend together in the sun, talking about footprints and a whole host of other things. Here is Jutta’s post about this – https://zmldidaktik.wordpress.com/2016/05/08/emergent-learning-in-the-lake-district/ 

Structure, agency and hard work

Today is my (our) wedding anniversary. Around about 47 years ago my father took his future son-in-law to one side and asked him whether he really wanted to go through with this marriage – my father was straight out of the Victorian era and doubted I would make a suitable wife – too many ideas of my own and insufficiently domestic 🙂 At the same time my mother took me to one side and asked me if I really understood what hard work marriage would be. However, a strong family belief was that anything could be achieved with hard work – so it must have rubbed off somewhere, since it seems to have paid off. We are still together after 47 years.

Also today, 47 years after my mother’s heart to heart, I have been hard at work thinking about the relationship between structure and agency in learning, for a paper I am writing with my Austrian friend and colleague Jutta Pauschenwein. So many people and well-known theorists have written about this that I wonder why it still seems to be a significant issue. That is what we are trying to pin down in our paper. I’m not sure yet if we will be successful. Despite my parents’ beliefs, hard work doesn’t always pay off, but I hope it will in this instance.

But pay-offs aren’t always what we expect, particularly if we keep an open mind about what might crop up, i.e. be open to emergent learning. I have done a lot of reading this month. Pay-off enough for me is coming across an article that makes me ‘sit up’ and leaves me thinking about it for days. This month it has been Osberg and Biesta’s paper on emergent curriculum.

Osberg, D., & Biesta, G. (2008). The emergent curriculum: navigating a complex course between unguided learning and planned enculturation. Journal of Curriculum Studies, 40(3), 313–328. doi:10.1080/00220270701610746 – Retrieved from https://dspace.stir.ac.uk/bitstream/1893/464/1/emergent-curriculum%20jcs%202008.pdf

This made me think about structure and agency in relation to the role of the teacher/facilitator in a learning environment that promotes emergent learning. Having started on my teaching career 47 years ago, I feel quite resistant to the idea that it is a role of decreasing significance in a world of open learning, where it is thought by some that everyone teaches each other. Of course I understand that everyone is capable of teaching others to some degree, and that open learning has increased the potential of learning from anyone and everyone, but I don’t think that this negates the significant role of the teacher. I am still working on why I feel so strongly about this.

My third experience of ‘hard work’ this month came from a 5 day city break to Berlin, where I walked miles and came back ready for a break! There is so much of interest to see in Berlin (we barely scraped the surface) and the German people are very hospitable. I would recommend a trip to Berlin for anyone who is interested in history, art, culture and architecture – and according to my son Berlin has a great music culture and night life – although we didn’t explore this – too exhausted after hours of walking!

Brandenburg Gate

Of course, there is plenty about Berlin that can be related to hard work and structure and agency. Once you start thinking about structure and agency, you see it everywhere 🙂

Reflections on the FH Joanneum (Graz) E Learning Conference, 2014

There is a tension between trying to explain emergent learning as related to our work on footprints of emergence, and maintaining an open emergent environment around the topic; something contrary in trying to reify emergent learning?

We are aware that the research we have been working on for the last 5 years or so is difficult to communicate clearly and we had to think very carefully about this for our recent keynote for the E Learning Conference at FH Joanneum in Graz, Austria, and German speaking audience.

We are also aware from workshops that we have run in the past, that we need a more straightforward drawing tool for producing footprint visualizations, i.e. a tool that minimizes a focus on the technology and allows for deeper reflection on the characteristics (factors) of open learning being considered.

To this end we asked a talented friend of my son’s, Mike Harding, who has the technical expertise, to help us produce some software which would enable easier drawing of the footprints. By help us, I mean do it! We don’t have the expertise. I should add that Mike has done this on a voluntary basis.

I do not have time or space in this blog post to explain the footprints. For readers new to this, please see this blog post ‘Characteristics of Open Learning Environments‘ and our open wiki.

Mike’s work is in progress. We discovered at the conference, as we expected, that the prototype he has developed does not yet work on tablets – but it does work in various browsers on laptops and PCs. The huge advantage of the tool is that it contains all the information about the factors (characteristics of open learning environments) within the website. In the past we have used paper templates for drawing the footprints and separate sheets of paper listing the factors with their descriptions. See for example the handouts that Jutta produced for the conference workshop. Handout (1) Handout-Footprint-zeichnen (1)

If you are interested in the development of this software go to http://www.footprintsofemergence.com/, register to create an account and just play. Click on the factor nodes for information about each factor and drag the factor to where you want it to be on the prescribed to chaos spectrum. If you haven’t a clue what this is all about – this video might help (although it refers to using a Word template, rather than this new software development).

There is still a lot of work to be done on the software. According to Mike, the first thing to be done is to sort out the mathematics behind all this. A correction to this would eradicate the pointed and overlapping lines on the footprint drawings, so that they appear more like the originals that we produced in Word.  There are also other developments that we have in mind, which I won’t go into here.

Below is my footprint, drawn using Mike’s software, which reflects my experience of the Graz conference. I have drawn this from the perspective of my experience of the day. Interpretation of this footprint has to bear in mind that I was one of the keynote speakers and speaking in English to an audience whose first language was German. Most of the papers presented at the conference were of course in German, although one was presented in English. Many thanks to Erika Pernold and Maja Pivek (Programme for Graz e-Learning Conference) for presenting their talk about the COPE14 MOOC  in English, so that we could understand – and Jutta Pauschenwein and I collaboratively ran a workshop at the end of the day in both German and English. In between these sessions, I stayed out of the German speaking sessions (unfortunately I do not speak German) and chatted with anyone who could speak English. These experiences obviously influenced the drawing of this footprint.


Screen Shot 2014-09-24 at 17.02.21

 

As mentioned above, this footprint reflects the fact that I was one of the keynote speakers. Those factors out in the challenging emergent zone are related to this. But there are also many factors in the sweet emergent zone. This related to the design of the conference. Lots of people knew each other – this was the 13th year this conference has run. There was a wonderful diversity of people from Higher Education, schools, training companies and charities and the conference was led by Jutta Pauschenwein who is committed to open learning and lots of interaction. The conference felt relaxed with plenty of time for people to talk to each other and it has been interesting today to read Patter’s post on unconferences. I think the Graz conference achieved a lot of what Pat Thomson writes about.

It has also been interesting to compare my footprint with the footprint that Jutta produced prior to the conference, i.e. a footprint of her design aspirations.

Screen Shot 2014-09-24 at 18.09.27

There are a number of similarities between our two footprints. Much of what Jutta aspired to in her design, I experienced. Where there are differences, I think they are due to my unique role in the conference and the fact that I was in a previously unknown country where I did not know the language or the culture. This was not a problem for me. I found the conference an extremely enjoyable experience – but nevertheless my footprint reflects my unique experience. There is no right or wrong in this, but it is interesting to make the comparison between the two footprints. Perhaps more useful than this, is for Jutta as the conference designer to make the comparison between her footprint and a series of footprints drawn in the workshop at the end of the day – as she has done in a recent blog post . These comparisons could potentially influence the design of future conferences.

These are only some of my reflections on the very rich experience of the Graz conference. Many thanks to Jutta and her team for making this a memorable event.

Evaluating open learning scenarios – keynote presentation

Here are the slides and notes for the keynote presentation that Roy Williams and I gave at the E Learning Conference, FH Joanneum, in Graz, Austria, on Wednesday 17 September 2014. This keynote included two interactive activities – see slides below, but  Slideshare does not enable powerpoint animations, so the post below also includes links to the original powerpoint.

Many thanks to the conference delegates for being active, friendly and supportive participants, especially given that we were not speaking in their native language, German.

The conference instigator, Jutta Pauschenwein, has written about the conference on her blog –http://zmldidaktik.wordpress.com/2014/09/21/elt14-rund-um-offene-lernszenarien-und-ihre-reflexion/ and there are further posts on this blog about our preparations for this conference.

————————————————————————————————————————-

Notes to accompany each slide:

Keynote presentation notes:

 1. A brief introduction to who we are

Jenny: I am an independent education consultant and researcher and have been working with HE institutions in this capacity since 2005. I have been publishing research since 2008. My whole career has been in education, starting with teaching in schools, and before going independent, working in HE as a teacher trainer. This involved developing and running a distance learning teacher training programme, which in turn led to an ongoing interest in how learners learn in open learning environments.

Roy: I am interested in exploring ways for people to explore, create, reflect on, and share their learning – individually and collaboratively.  I work and publish across several fields: semiotics, critical discourse analysis, epistemology, ecological psychology, politics, narrative, e-learning, e-assessment, knowledge management, synaesthesia, complexity theory, international development, art design & media, and most of all, on open learning.

2. How did we meet and start working together?

This is a cMap, created by a colleague we have worked with in the past, Matthias Melcher, to explain the open learning environment of the CCK08 MOOC. This was the first MOOC on Connectivism and Connective Knowledge run by Stephen Downes and George Siemens in 2008.

We did not know each other at this point and you can see that we did not even meet in the MOOC. Roy for the most part occupied the forums and Jenny worked on the MOOC from her blog.

You can see from the rest of the map that there were many locations to work in on this MOOC and participants could choose where to work from, which paths to follow and who to connect with. This truly was an open learning environment, with participants working autonomously across distributed platforms. The environment encouraged autonomy, diversity, openness and interaction.

We finally ‘met’ (virtually) at the end of this MOOC, when we began to collaborate on two research papers in which we investigated learners’ experiences in this MOOC. These papers were ultimately published in the International Review of Research in Open and Distance Learning, an open journal. We have listed the full references at the end of this presentation.

3. Why are we interested in emergent learning?

Following our research into our first MOOC experience, we realized that it was very difficult to ‘pin down’ and explain how and what learners learned in the MOOC and began to understand that this was because much of the learning was unpredictable, unexpected and emergent. In open learning environments we (as teachers) cannot know what learners are doing – what they are learning.

An example of this in nature is the way in which flocks of starlings form murmuration patterns just before roosting at the end of the day. In this behaviour, the patterns the starlings make and the directions they follow are always unpredictable. In addition, there is no leader. They are self-organising, constantly changing and adapting their direction as information is passed between the birds through continual interaction. This is a social behaviour.

Another example of emergent learning that we wrote of in one of our first papers, which is nearer to our work as teachers, was the example of April, a mature, part-time student of Early Years Education, who worked as a manager of a pre-school. She visited a pre-school centre of excellence and was impressed by how quiet and well-behaved the children were and how there were glass bottles and vases of flowers on the tables. She took this unexpected learning back to her own pre-school where she instigated changes. This learning journey was unexpected and beyond the prescriptive learning programme of her course. This was transformative learning for April.

We have recently submitted a book chapter in which we discuss the relationship between transformative and emergent learning. We believe that open learning environments offer potential for transformative learning.

4. What is an open learning environment?

This image shows some of the characteristics of an open space reaching into the distance, where we can’t see what is over the horizon. But the image only shows one path. In open learning environments there are many paths and the learner is free to choose which path to follow. It might be that the learner chooses to follow a more prescribed path as shown in this image, but equally the learner may choose to go off the prescribed path and out of the sight of the ‘teacher’.

So open learning environments can be experienced as quite safe – by following the prescribed path – or much less safe, e.g. a learner may get lost or fall off the edge of a cliff. On the other hand the learner may really enjoy freely wandering about in the environment. If learners leave the prescribed path they don’t know who they will meet or what will happen. The learning outcomes are unpredictable.

A key thing about open learning environments is that they offer learners the choice of which paths to follow.

These were our early thoughts about open learning environments which we then began to develop.

5. We started to think about all the factors which might influence learning in an open learning environment and quickly realized that these characteristics could be grouped into four clusters.

Two of these clusters relate to the learning environment and the other two to the individual learner. So we started to think about what the structure of an open learning environment might look like and how that environment might promote interaction.

And then we thought about how the learner can take control of their learning (agency) and what kinds of activities the learner might be involved in, to establish a presence in an open learning environment. So the questions we are interested in, in relation to the four clusters are

  • What is the balance between Openness and Structure? (Open/Structure)
  • How is the learning design implemented? (Interactive environment)
  • Do learners develop their own capacity for action, or just compliance with given roles? (Agency)
  • What traces do you make and leave behind you? (Presence/writing)

6. Ultimately we ended up with 25 characteristics or factors organized into the 4 clusters, which we think enable a learner to reflect on their learning experience in any given learning environment.

Why 25? Well – there could have been more, but we consider these to be the most important factors to consider. But this is not a definitive list. There could be alternative factors and some factors might not be useful to some learners, teachers or designers.

This was not the first list we came up. It took us a considerable amount of time to refine this list, but testing it out on various audiences and groups of learners.

The presence/writing was the most difficult set of characteristics to determine, but we knew that we had to consider the trace that learners leave behind them as they move through an open learning environment, or even a more prescribed course.

7. In thinking about how to describe the factors in each cluster, we have recently added an image to each description, thinking that perhaps this might make the factors easier to relate to, for some users of the footprints of emergence framework. These are the images we have selected for the Openness/Structure cluster.

8. These are the images we have selected for the Interactive Environment Cluster.

9. These are the images we have selected for the Agency cluster.

10. These are the images we selected for the Presence/Writing cluster. This was the last cluster of factors that we worked on, when we realised that learners need to be aware of the traces that they leave when they interact in open learning environments.

11. So now we had 25 factors organized in 4 clusters to use for reflecting on any given learning experience, but particularly learning in open learning environments. Whilst we could score these, or write about them in a list, we realized that some sort of visualization would have far more impact on learners and would also help to explain the environment as we understand it.

The animated gif created by our colleague Matthias Melcher, gives a sense of how precarious and unsafe an open learning environment might be and how easy it might be to fall off the edge as many MOOC participants do, i.e. they ‘fall out’ of the course. But the gif gives an impression that you can also fall through the middle which doesn’t happen in our framework. (Slideshare does not enable animations. Please access the link to see the animated gif).

In our framework – you can see a cross section of it on the slide – the central zone (the dark blue centre on the footprint template) is the safe prescribed zone. It is safe and comfortable but also quite restrictive and a learner has to make quite an effort to climb out of the valley and up onto the open plateau, which we have depicted in white in the template (where learning is likely to be sweetly emergent). Here the learner has many more choices about which paths to follow, but the as the learner moves further away from the centre and towards the darker blue edge, the learning becomes more challenging. We have described this as the sharply emergent zone. The learner may or may not enjoy this challenge. If the learner gets too close to the edge, the learning will be experienced as chaotic and the learner is in danger of falling off the edge (the dark blue zone).

We think it is possible to describe any learning environment as being on a spectrum between prescribed and chaotic and have thought about our 25 factors in those terms.

12. Here is a slide of how we have described the first two factors in the Open/structure cluster.

We have named the factor and given it an abbreviation for ease of reference, provided a graphic image which might help more visual learners, raised a question to prompt reflection and described the spectrum from prescribed to chaotic learning,

This sheet is used when drawing footprints of emergence and users are encouraged to add comments which explain how they have interpreted each factor in relation to their own learning experience.

13. Where have the factors come from?

Well they have not been ‘plucked out of thin air’. In thinking about how learning emerges in open learning environments we immediately drew on complexity theory and ideas of adaption and self-correction.

The influence of Etienne Wenger’s work and his emphasis on communities of practice, social learning, interaction, negotiated learning and identity development can be seen in the list of 25 factors.

Our experience of MOOCs and knowledge of connectivism, from the work of Stephen Downes and George Siemens, has been influential in the choice of factors for all the clusters, factors such as risk, disruption, multipath, co-evolution, self-organization, autonomy, diversity etc.

We think it would be fair to say that most teachers have been influenced by social constructivism; in their creation of experiential learning environments, recognition of ambiguity and liminal space and their emphasis on trust and support.

Finally Gibson’s work on affordances can be recognized in many of the factors. Social media offer many affordances and possibilities for emergent learning. Twitter, for example, allows for many casual, serendipitous encounters, informal writing and networking.

14. Let’s consider one factor in more depth and how it might have impacted on your own learning, by working on a short activity, which will involve discussion in groups of 4

15. This is an outline of the activity in English. We’ll read through it here first, but the next slide has the same information in German. You will have 10 minutes to discuss the questions in groups of four

  • How have you experienced risk?
  • How does risk affect the way you learn?

And then for 5 minutes we will take feedback in English from some of the groups. So one person in each group should be prepared to feedback one statement about how risk affects learning or the design for learning.

16. Activity instructions in German

17. Our experience is that emergent learning will occur when there is frequent interaction between many people and resources, where no-one is able to follow everything, as happens in most MOOCs. In these circumstances people need to be self-organising and independent and the environment needs to be adaptive. Learning will be unpredictable and emergent.

So how do we know what our learners are doing in these environments.

We have created the drawing footprints tool to help to visualize these emergent learning experiences.

18. Here is an example of a drawn footprint.

In the Table is a list of the factors we have already discussed and their associated abbreviations. You can see these abbreviations beside the points on the footprint line. Each point has been placed on the spectrum between prescribed and chaotic learning. So, for example we can see that the factor Experiential in the Interactive Environment cluster was thought to be very challenging and near the edge of chaos.

The image of the palette is there because we view the list of factors as a palette that you can choose from, just as an artist chooses colours to paint with. Not all the factors need to be used.

The footprints can either be drawn by hand or electronically.

19. Let’s have a quick look at some examples of drawn footprints.

A footprint of a standards driven course (e.g. teaching, nursing) is likely to look like this, i.e. very much in the prescribed zone – but this footprint would help designers to reflect on the possibility of making some changes.

20. This footprint shows that it’s possible to superimpose one footprint on another. In this case the footprint show the learners interpretation of the course design intentions (the yellow line) and the actual learning experience (the red line)

Through this different footprints can be compared – in this case a perspective of the design and one of the actual experience. i.e. the experience was far more chaotic than intended.

21. Footprints can also be used to show how the experience of learning changes over time. Here on the top left the learner has drawn her perspective of the design intentions for the course. The footprint top right was drawn at the end of Week 1, bottom left at the end of Week 2 and bottom right at the end of Week 4. Whilst at the end of Week 1 the learner is experiencing what she expected, the experience in Week 2 and Week 4 is far less comfortable.

22. Now we would like you to think about a course you have recently taught or taken. (The animation in this slide and the next one does not show in Slideshare. To see how it works see the powerpoint presentation – Surfacing, Sharing and Valuing Tacit Knowledge 17-09-2014.

Overall would you describe that course as being in the prescribed learning zone, the sweetly emergent learning zone, the challenging emergent learning zone, or was it chaotic, or did you fall out of the course, off the edge.

You can see that when we click this red button it moves along the line.

When we do this again. We would like you to stand up when the red dot reaches the zone which describes your experience and sit down when it leaves the zone.

23. Stand up and sit down now.

24. We see the footprints as a tool for reflective practice. We have deliberately made it a flexible tool. Factors can be used or discarded. They could also be changed. For example if we were working with children, we would need to adapt them. Maybe the children themselves could suggest how to adapt them.

Currently the research into learning experience in MOOCs and open learning environments is focusing on gathering Big Data. We don’t believe that this can capture the learner experience in open learning environments, because much of that learning will be invisible and unpredictable, but nevertheless valuable and possibly transformative for the learner.

For understanding learning in MOOCs and open learning environments we will need tools that can encourage learners to deeply reflect on their experience. Our experience is that drawing footprints can do this, but they are nor a quick fix. They require time, thought and discussion.

25. We believe that the value of drawing footprints lies in providing a tool for eliciting tacit knowledge and understanding with minimal or ‘light touch’ facilitation/disturbance. Standard evaluation tools such as questionnaires, tend to be for the benefit of organisations and teachers, rather than for the learners and do not encourage depth of reflection. Drawing footprints encourages learners to dig deeper.

26. Here are some final thoughts, which we have only summarised here but which we discuss in more depth in the paper we have submitted for this conference.

Williams, R. & Mackness, J. (2014). Surfacing, sharing and valuing tacit knowledge in open learning. 13. ELearning Tag FH JOANNEUM am 17. September 2014

Future directions for the Footprints of Emergence framework

This is the last in a series of five posts written in preparation for an e-learning conference keynote that Roy Williams and I will be giving on September 17 in Graz, Austria.

First slide in presentation

Previous posts relating to this presentation are:

  1. Evaluation of Open Learning Scenarios
  2. Characteristics of Open Learning Environments
  3. Emergent Learning in Open Environments
  4. Theoretical influences on the characteristics of open learning environments

Our research [1] [2] focuses on how learners experience complex, unpredictable, uncertain environments, such as MOOCs, where their learning is likely to be emergent.

Over the last two or three years the amount of research into learning in MOOCs has grown. See for example MOOC Research Initiative Reports from the Gates Foundation funded projects  and the proceedings from the European MOOCs Stakeholders Summit 2014 .

Some researchers, like George Veletsianos [3], have questioned whether there is enough emphasis in recent research on the ‘learner voice’. This is a question that also concerns us. We believe that it is essential to encourage and listen to the ‘learner voice’ (whoever that learner might be), if we are to understand the epistemic and ontological shifts and transformational learning that can happen in open learning environments.

The Footprints of Emergence framework is a tool [2] [ See also previous posts in this series], which can be used by learners to surface the deep, tacit knowledge and understanding that is associated with these transformational shifts in open learning environments such as MOOCs. We are interested in learning more about the impact of open learning environments on these shifts by encouraging learners to be researchers of their own experience.

The Footprints of Emergence framework [2] [4] can be regarded as a probe for evaluating learning in open environments. It engages learners in deep reflection, supports them in taking control of their own reflection and evaluation, can be used to encourage discussion and collaboration between learners, teachers and designers, and can be used to visualise the dynamic changes that occur in learning over time.

A difficulty that we have encountered with the framework and drawing tool is that they require explanation and practise in use, i.e. they require time and effort to engage with, sometimes more time than people have and more effort than people want to make. Our aim is to try and simplify the process, without losing the depth of reflection that the current process leads to. To this end we are, through a colleague, hoping to develop some software, which will make the drawing process more straightforward. This would leave the user freer to concentrate on the meaning and use of the factors (see the second post in this series for more information about the factors) and the interpretation of the final footprint visualisation. The development of some software would also potentially make it easier to work with larger groups of learners.

Such a development would enable us to focus on the meaning of evaluation of learning in open learning environments. This has been challenging us for some time. If learning in these environments is emergent, surprising and unpredictable, how can we ‘capture’ it and value it. The common response in current MOOC research has been to try and scale up traditional assessment methods through the use of big data, automated assessment or peer review. Our current thinking is that new paradigms such as open learning may require new ways of thinking about assessment. The Footprints of Emergence framework enables a move away from traditional approaches and puts the emphasis on reflection and self-assessment. This aligns with the view expressed recently by Stephen Downes [5] that we need to move beyond assessment [6] as we know it and put it in the hands of learners.

To summarise the directions in which we are moving: We are interested in –

  1. Exploring further the characteristics of open learning environments that result in transformative learning
  2. Increasing our understanding of how learners learn in open learning environments
  3. Finding new approaches which go beyond assessment and put learning and assessment in the control of the learner
  4. Exploring the notion of probes for assessment and learning design
  5. Developing the footprints of emergence drawing tool so that it can be used more easily with larger groups of learners.

References

  1. Williams, R., Karousou, R. &  Mackness, J. (2011) Emergent Learning and Learning Ecologies in Web 2.0. International Review of Research in Open and Distance Learning. Retrieved from: http://www.irrodl.org/index.php/irrodl/article/view/883
  2. Williams, R., Mackness, J. & Gumtau, S. (2012) Footprints of Emergence. Vol. 13, No. 4. International Review of Research in Open and Distance Learning. Retrieved from: http://www.irrodl.org/index.php/irrodl/article/view/1267
  3. Veletsianos, G. (2014) ELI 2014, learner experiences, MOOC research, and the MOOC phenomenon – Retrieved from: http://www.veletsianos.com/2014/02/10/mooc-research-mooc-phenomenon/
  4. Footprints of Emergence open wiki – http://footprints-of-emergence.wikispaces.com/
  5. Downes, S. (2014) Beyond Assessment – Recognizing Achievement in a Networked World Jul 11, 2014. 12th ePortfolio, Open Badges and Identity Conference , University of Greenwich, Greenwich, UK (Keynote). Retrieved from: http://www.downes.ca/presentation/344
  6. Mackness, J. (2014). Blog post – Beyond Assessment – Recognizing Achievement in a Networked World. Retrieved from: https://jennymackness.wordpress.com/2014/07/13/beyond-assessment-recognizing-achievement-in-a-networked-world/

Theoretical influences on the characteristics of open learning environments

This is the fourth in a series of posts written in preparation for an e-learning conference keynote that Roy Williams and I will be giving on September 17 in Graz, Austria.

First slide in presentation

Previous posts relating to this presentation are:

  1. Evaluation of Open Learning Scenarios
  2. Characteristics of Open Learning Environments
  3. Emergent Learning in Open Environments

In the second post in this series I wrote about the 25 factors that we consider to be characteristics of open learning environments.[1] [2] The evidence from our research suggests that the presence or absence of these factors influences the potential for emergent learning in any given environment.

We have been asked a few times where this list of factors has come from.[3]

The factors are not arbitrary. They are a result of much reflection and discussion and of our combined extensive experience of teaching and learning, and personal knowledge of open learning environments and theoretical influences. Here is the current full list of clusters, factors and their descriptions. Clusters and Factors Mapping Sheet

Experienced educators recognise the importance of prior learning in developing knowledge and understanding. In retrospect, it is easy to see that a career in education means that this prior learning has often been associated with specific learning theories and theorists, even if this wasn’t consciously recognised at the time.

On a personal level, it is interesting to consider which past learning events may have been associated with which learning theories. In the Table below I have attempted to make these links between significant prior learning events in my career and the associated theorists and theories that have probably influenced my thinking about emergent learning.

Image for blog post 4

This Table is necessarily a summary overview, but reflects some of the influences on my thinking and therefore the discussions I have had with my colleagues in relation to our work on emergent learning and deciding on a list of factors. It is not that we sat down, drew up a list of theories and from these decided on the factors. At the start of this work we drew on our very recent experience of participating in CCK08 (Connectivism and Connective Knowledge MOOC, 2008) and on our experience of autonomy, diversity, openness and connectivity within it. These are the four key principles of learning in a network, which Stephen Downes introduced us to in CCK08.[4] As we shared and discussed our experience, we recognised that we were describing it in more detailed terms than the four principles for networked learning. We realised that the language we were using to describe this experience reflected our past experience and knowledge of theorists and theory.

Discussion also included how to cluster these factors. Pragmatically, and after some testing of different ideas and numbers of clusters, we knew that in order to draw the Footprints of emergence (see the second post in this series for an explanation and example of a ‘footprint’) it would make sense to organise them into four clusters. This works well. We have two clusters that relate to the learning environment – Open/Structure and Interactive Environment; the other two clusters relate to the learner – Agency and Presence/Writing.

The clusters and factors have been tested and refined many times, with different groups of learners in different learning environments. The most difficult aspect of this work has been to develop concise descriptions and associated questions, which we hope will support people who use the Footprints of Emergence framework to reflect on their learning in different learning environments.

So whilst we can each explain how we arrived at a list of factors from our own perspectives [ See 5, for Roy’s perspective], we are doing this retrospectively. At the time, the process was hard work, but complex, messy and unpredictable. It has been what Stephen Downes referred to as design-led research in his talk – Digital Research Methodologies Redux. [6]

References:

  1. Williams, R., Mackness, J. & Gumtau, S. (2012) Footprints of Emergence. Vol. 13, No. 4. International Review of Research in Open and Distance Learning. Retrieved from: http://www.irrodl.org/index.php/irrodl/article/view/1267
  1. Footprints of Emergence open wiki – http://footprints-of-emergence.wikispaces.com/
  1. Mackness, J. (2013). Footprints of emergence – so what? Retrieved from: https://jennymackness.wordpress.com/2013/09/11/footprints-of-emergence-so-what-2/
  1. Downes, S. (2009). Connectivism Dynamics in Communities. Retrieved from: http://halfanhour.blogspot.com/2009/02/connectivist-dynamics-in-communities.html
  1. Williams, R. (2014). From here to CAN. Retrieved from: http://k-m-etaphors.wikispaces.com/From+here+to+CAN
  1. Downes, S. (2014). Digital Research Methodologies Redux. Retrieved from: http://www.downes.ca/presentation/341