Coming Back Full Circle with Nada Dabbag
Ep. 09

Coming Back Full Circle with Nada Dabbag

Episode description

Looking back at this past academic year, marking 25 years at George Mason University and 28 years in higher education, I engaged in two grant writing experiences that took me back full circle to my dissertation study. Really? Who would have thought with everything going on in our field that I can circle back to personalizing instruction when writing these grant proposals. Specifically to contextualizing instruction to students’ most-preferred and personally-relevant interests which was the title of my dissertation. Even more surprising was the recent connection I made between generative learning and generative AI. It was an aha moment for me. Remember Wittrock’s (1990) Generative Learning Theory and Weinstein’s Learning Strategies Model? Well, in the age of generative AI, this is making a lot of sense. So is the concept of “mindtools” which I was introduced to by my late mentor (David Jonassen). I would like to share the story of my academic journey on the DS106 Radio Summer Camp and how I came back full circle to concepts I learned almost 3 decades ago! And they still make sense! But does our field still make sense? Can we still call it Educational Technology? Or Instructional Technology? Or Instructional Design? Or Learning Design? Or Learning Engineering? Where are we going with this ever-evolving field? I would like to end on this note.

Download MP3

Download transcript (.srt)
0:00

All right, we are live on DS 106 radio

0:04

I'm Meredith Huffman, and I'm joined here with

0:07

nada

0:10

dabig from George Mason University to talk through

0:14

her session on

0:16

This this hour of the reclaim radio. I'm also joined with Taylor Jaden as well to introduce as we get started

0:23

Great. Thanks Meredith. So I'm nada

0:29

Daba I know my last name is a little difficult to pronounce but

0:34

That's fine. I

0:37

am a professor at George Mason University as

0:42

Meredith mentioned I've been at George Mason for a long time too long almost 28 years now, but

0:50

I'm also the director of the division of learning technology

0:55

So my specialty areas are of course looking at the affordances of learning technologies and instructional design

1:03

And how can we?

1:05

design

1:07

effective and meaningful

1:09

learning experiences using

1:11

technology and so I

1:15

Was interested in this DS

1:19

106 radio because I do have an account on

1:24

Reclaim hosting and I was interested in this summer camp

1:28

Thing because I've never done something on radio before and so, you know, I'm

1:34

You know sort of old-fashioned. So when you guys said radio, I'm like sure, you know

1:41

why not get my voice out on a

1:44

Radio which you know in my mind thought about it more like a podcast kind of thing

1:50

But you know, yeah the word radio sort of, you know rings, you know old

1:56

media to me so I was I was intrigued by that and

2:01

You know, they asked okay pick a theme so I picked a theme

2:07

You know about storytelling and I know the gym is very much into storytelling and so

2:17

I kind of wanted to look back at the last academic year and sort of share

2:22

my highs and and lows and so

2:26

I

2:28

decided to

2:30

title my session

2:32

You know looking back so sort of coming back for full circle

2:38

so, you know, I'm at a point in my career where I'm looking at our field and it's just really difficult to

2:47

to

2:49

Define our field if you will, so I'm gonna I'm gonna share on my screen now and

2:54

Just show this one slide, you know when I graduated from Penn State

3:00

in

3:02

1996 my degree said

3:05

Instructional systems design so at the time

3:10

If you see, you know

3:13

Down here at the bottom of this slide. I'm going to highlight it

3:16

instructional systems design or ISD was really the

3:22

Kind of the name that my field went went by right because we were looking at systems

3:29

We looked at designing instruction

3:32

Using learning systems. We borrowed from computer science and engineering. So all about systems theory and

3:41

You know, how can we design an instructional system? But if you look at the slide again, you'll see that you know

3:48

the associations that I

3:51

belong to for instructional design like a CT and you know

3:58

you learn and

4:00

ACE and others they call our field so many different things like here at the top. It's called

4:09

Instructional technology, which is a much broader term and it's defined as the discipline in which learning theories become concrete

4:16

through the use of tangible

4:18

resources such as you know

4:21

Technology. It's also called instructional design and it's also called

4:26

Right now it's called, you know instructional design and technology

4:31

But right now we even are calling it learning design and and technology. So

4:38

I'm gonna stop sharing now. So we even are calling it now user experience design

4:44

So learning experience design, so there's you know, there is so many different

4:49

Notations for our field that it's it's confusing and

4:55

I'm trying to you know, look coming back full circle

5:01

I'm just trying to figure out how did our field evolved and what what is the cause of this?

5:08

Constant, you know evolution and I came to terms

5:13

Thinking that you know

5:15

We are always piloting change in our field

5:18

Why because technology is just he's changing and we have so many different affordances

5:24

Look at what we're doing right now

5:26

I mean we're meeting on a on a platform that you know

5:31

Every one of us is in a different location and we are you know, seeing each other and we are in our homes and we

5:39

are

5:41

Recording so

5:43

I think that our field or my field has always been sort of I wrote down like in in this

5:49

Pilot mode or in this beta mode kind of like software, right when Microsoft comes up with a software update

5:57

It's you know, why do we have so many updates, you know, why do we have so many like, you know

6:02

we can't we keep we keep doing updates because

6:05

Technology is always in beta mode

6:07

I mean it has to keep evolving and it has to keep

6:11

We have you know version one and version two and now we are Microsoft

6:15

11.1 and who knows we keep going until version

6:19

20 point something in every software that we use and then finally the whole software either dies or something else comes aboard and then

6:27

Now we have to learn how to use something else or a different operating system or a cloud platform or whatever. So

6:34

One of the reasons why I think our field is in constant beta mode is because you know

6:42

instructional design and technology uses technology to support

6:46

workforce education and training in all kinds of different contexts and

6:50

multimedia and all that so I think that

6:54

Yeah, that is one of the reasons why we keep we keep evolving and the name of our field keeps evolving and now we're even

7:02

Calling it learning engineering that kind of comes back in circle like yeah, and I see Taylor here

7:08

You know nodding and so you've heard the term. Yeah, I

7:13

It's probably unfair

7:16

Because I always kind of a little bit laugh at learning engineering because to me it always feels and again

7:22

I I don't know a lot about where the term comes from but from the outside looking in at it

7:27

it sounds like someone felt like

7:29

Technologist or instructional designer wasn't legitimate sounding enough. So they were like, well, what if we put math in here?

7:36

Let's call it engineering and I'm like, I'm not sure how much math is in that role on an average day

7:42

But whatever, you know

7:44

I'm being a little bit hypercritical. It's probably an unfair take of that term, but I know it kind of makes me smile, you know

7:50

Yeah, thanks for for for weighing in so I'm gonna

7:54

share my

7:56

screen again because

7:58

Yeah, I'm trying to grapple with this term as well

8:03

Because

8:06

The the definition and as you could see now on this slide

8:11

It's really you know, what characterizes engineers and I think it's like design is the glue, you know

8:18

Engineers are designers, you know, they invent this from Wikipedia. They design they analyze they build they test

8:26

We do the same as instructional designers and learning designers. I mean we are

8:31

We're designing

8:33

learning interactions, we're designing learning experiences and so

8:37

We have to you know, look at our audience look at the context and design and do a needs assessment and all that

8:45

So it's I guess the scientific method which is sort of you know, we hypothesis testing

8:51

I don't think we do much of that

8:53

But we do definitely have to problem solve because we go into an organization and we're like, okay

9:00

Your performance is down and you think you need

9:03

to get your employees to learn something new or to upskill or to reskill or to retool and

9:11

Therefore, you know you need us instructional designers to create some, you know learning interactions for your employees

9:18

And so that is a problem-solving approach, right? Like

9:22

That is where we yeah, we need to go into that organization and figure out you know

9:27

What is what what skills do they need to improve their performance?

9:33

And and you know, what type of audience do we have here? Are they adult learners? Are they you know?

9:41

K-12 learners are they students? So yeah, so going back to learning engineering, I think

9:48

The definition in Educause 2018 is the application of engineering

9:55

methodologies to develop learning technologies and infrastructures to better support learners and learning

10:02

So well, that is the official I guess definition. So it kind of makes sense

10:08

but again, you know our field keeps evolving and now for example at

10:14

What is this the Carnegie Mellon Carnegie Mellon

10:19

I only know of two universities that have adopted a learning engineering curriculum. So Carnegie Mellon has a

10:27

metals program

10:29

That you know Masters of Engineering in technology

10:34

and

10:36

I forget the actual what the acronym stands for but these are the

10:41

you know the outcomes if you were to get that master's degree and then I'll also

10:47

up in

10:50

Boston College

10:51

They also have a new learning engineering curriculum and you know, I guess there again

10:58

they're trying to integrate more the

11:01

the hypothesis testing the

11:04

the the infrastructure the systems thinking and

11:08

You know

11:10

making connections between technology and developers

11:13

Because you know, this is what really bothers me is the software developers. I'm sorry

11:19

I'm not trying to offend anyone but the software developers

11:23

you know, they're very smart people and they they just like develop all the software that we use but without

11:32

Taking our input they don't come to me as a faculty member at George Mason University and say, okay, how do you teach?

11:39

What's your pedagogical approach? You know, do you use experiential learning with your students?

11:44

Are you a learning by doing person or do you just lecture and then give your students midterms and finals?

11:52

so

11:53

software developers who are developing platforms for learning or for educators need to speak with educators and

12:01

really understand what educators do and how do we teach or how do we do research and

12:08

you know, for example, you know, they've come up with all these learning management systems blackboard and canvas and

12:15

You know who knows so many of them, but they're just built in my opinion those software developers

12:23

They did a great job. I mean the university does need a centralized

12:27

System, I guess because we're still mired into that credit our system FTE and the courses

12:34

what they do is they just like

12:36

You know

12:39

Have a bunch of courses connected and it's all the same format and it's all based on the faculty

12:45

uploading their content to that platform and then you know

12:50

Stereotyping their lectures and uploading their lectures and they think that that's it. No, it's not it

12:56

That's not how I teach. I don't want my students to be just you know, listening to my lectures and just then

13:03

Taking a test test test and then just you know, I don't want them to memorize the content

13:10

I have learning outcomes and that's where instructional design comes in

13:13

I mean and I try to align the learning outcomes in a course that I'm teaching to the learning activities

13:20

To the assessment. So that's the backwards design model in instructional design is when you really have this

13:27

pedagogical alignment right where you're really trying to

13:31

Be you know align

13:34

the the the learning outcomes with the learning activities that you give your students or employees at an organization to

13:41

Work through or the learning interactions or the learning experiences, you know to to the assessment. And so

13:48

Yeah, so that's why that learning engineering term, you know, I'm trying to again figure out why

13:56

There's so much push to move our field again. So instead of calling it instructional design and technology now

14:02

We have to call it learning design, but now we have to call it learning engineering. I don't know but

14:09

Going back to my coming back full circle one thing I can tell you that I felt really

14:16

cool about and I was so like so that that kind of maybe stayed the same and made me think you know, no, there is some

14:24

grounding here because

14:27

Lately and as I as I reading back that submission that I did for this for this radio summer camp

14:34

It said, you know looking back at this past academic year

14:39

You know, I engaged in two grant writing experiences that took me back full circle to my dissertation study

14:45

My dissertation study was back in 1996 and it was about personalizing

14:52

Instruction to students most preferred and personally relevant interests

14:58

So that was personalization at the time and what I did at the time is

15:03

You know

15:06

Students at Penn State just didn't like statistics. Nobody liked to take a course in statistics

15:12

They all had to take a course in statistics and the way it was taught was very

15:17

conventional like, you know, they wanted to teach them how to compute means and medians and averages and

15:25

Like that scales and they did it through

15:28

because it was a gen ed course that everyone had to take and so they did it using lectures and

15:36

I was like, why do students they don't like the way this course is designed. So let me try to figure out

15:42

How to design it in a way that is more relevant relevant to their

15:47

Experiences at Penn State as a student. So actually what I did was is I had them

15:54

Collect data like I would ask them how many beers do you drink a week or you know?

16:01

And I will have them create data sets based on their life

16:06

experience like how many how many parties did you go to this week or

16:11

How many you know?

16:14

Dances, did you go to or how many girlfriends have you had?

16:19

since you started your freshman year or so I was trying to relate the

16:27

The learning of statistics to their personal

16:31

Relevant interests and I thought at the time that you know

16:36

If I connected numbers to what they're doing in their daily lives as students

16:42

Maybe then so then they would build data sets as groups

16:46

And so we would have all these data sets of the number of beers

16:49

That they drink at a certain party the number of this or that and then I would ask them

16:55

Okay. Now, let's let's compute the average of

16:58

the number of beers that you drink let's compute the the mean or the median of

17:04

The the number of parties that you went to or something like that

17:08

So then they can get a sense of how this data, you know is transformed through statistics

17:15

To to give us some, you know results that they can work with or evidence-based

17:21

Results or empirical results so they can understand the value of statistics. So anyway, I'll stop in a minute

17:28

But this was this was my dissertation and now I find myself

17:33

After 28 years. I just published a book

17:37

called a personalized learning experiences with one of my doc students and it's called designing personalized learning experiences a

17:45

framework for

17:48

Higher education and workforce training so circling back, you know

17:53

28 years since my dissertation

17:55

I'm back to personalized learning. So that was really cool for me because I was like, whoa

18:01

It's it's a hot topic now and it was a hot topic when I did my dissertation eons ago. So maybe that is something

18:09

That's really cool

18:12

In my field that I can talk about I have another you know concept that I also want to talk about

18:17

But let me know if you want to add something or ask

18:19

Sure. Well, um, there's a there's a lot of

18:23

Discussion going on in the discord. So there's there's plenty of shared

18:27

Disappointment or frustration with the LMS just want to let you know

18:33

So you're definitely not alone there and I will say as a technologist who spent

18:38

About eight years in in working in higher ed

18:42

I don't know that our my motto at my previous job was literally no one likes LMS

18:48

There isn't a person right? It's designed for nobody because it's attempted to be designed for everybody

18:54

That's the problem for sure and and you know one thing I wanted to kind of add because I think you're completely right about

19:02

The way their design doesn't meet

19:05

The needs of teachers or students and I think it's it's kind of a simple problem

19:10

And that's just most people don't know that the field of education

19:14

Educational psychology exists or what it says

19:17

Just most unless you unless you've been through teacher education training or you've encountered this or you've studied teaching

19:25

most people just aren't aware of that stuff and so I think

19:28

you know folks who are

19:31

Planning what features an LMS should have and what what they should provide

19:37

They're not really thinking in that light from that angle there there plus there's all of course also business motivations

19:44

Why you know they have other?

19:46

Objectives and goals than you or I would someone who's using the system

19:50

unfortunately

19:53

Because I'm gonna share my screen again because you are spot-on in terms of

20:02

Our field what might be an instructional design? I have a slide here

20:07

It borrows from at site like you said educational psychology is right here the social sciences

20:13

So we you know

20:14

We are steeped in the learning sciences or if you want to call it the cognitive sciences how people learn and of course at site

20:22

educational psychology and learning theory and then of course we borrow from the information sciences communication theory

20:30

computer science and now engineering and

20:32

Information management and in the old days it used to be audio visual technology and then at the bottom here

20:39

I have the management sciences the systems theory the systems analysis and design the operations research and

20:47

project management, so you're spot-on by saying

20:51

You know most software developers wouldn't know that if they're

20:57

Developing a learning system or platform to you know think about how people learn and so

21:03

you're spot-on and so

21:06

The the new however the problem the problem is because I do have a

21:14

sort of a solution and Jim is aware of

21:17

my

21:20

My other research interest and we personalized learning, but I'm also totally into what we call

21:27

Harold your jarci, I mean personal learning environments the problem with and I'd like students to

21:33

Create sorry. I'm scrolling through here to find the slide on PL ease, but the idea is to allow

21:42

You know students to create their own personal learning environment right using whatever tools they want, right?

21:50

They could use they could use a wordpress. They could use wikis

21:54

They could use you know, I mean, of course, they're gonna have to create a cast the problem with that though

21:59

And then we as faculty we become like facilitators for their personal learning

22:04

Environments and they try to then create their own content. They create their own learning interactions

22:11

I mean, that's huge

22:12

I'm a constructivist at heart meaning that I want students to create their own learning experiences

22:18

The problem is in higher education if we don't break away from that credit-bearing FTE core system

22:25

mean how is the institution going to

22:29

Demonstrate analytics or you know, if we don't go into X API and I have to figure out across all of that

22:36

The systems talking with each other. I mean that that's that's a huge impediment for

22:41

for that's why the LMS is still a staple because you know

22:45

It has everything in one place and people can go back and see the courses that they took and we can have surface learning

22:52

Analytics and figure out this or that and copy courses and the students are used to like a design

22:58

But ultimately you're right

23:00

Like if we you know, I don't want students to be tethered because when they leave the university then what I mean, you know

23:07

They're kind of done. What about lifelong learning? So then, you know, there are there are systems now that support lifelong learning, but again

23:15

like the Defense Acquisition University the ADL lab are considering a

23:21

Platform I forgot what I used to call it

23:23

I mean where where every one of their employees would create their own personal learning environment and then they can go learn something

23:31

Via YouTube or MOOC or they want to learn something new using some other system

23:37

but then there needs to be documentation and so the

23:40

Organization needs to document that my employee got a certificate or learned this skill or that skill so they need you know

23:48

Performance measures on that so that that is a problem, but I think if we can eventually get to that personal learning environment

23:56

Approach where every student is empowered to create their own digital learning space their own personal learning

24:05

environment using the the technologies that they are comfortable using

24:09

But then the teacher's job will become much more difficult because you're gonna have to kind of you know

24:15

Go into that personal learning environment for every student that you're teaching and then figure out, you know

24:20

How they're doing and are they actually processing the content and are they actually achieving?

24:25

so

24:27

So yeah that that thing but personalization is huge. I would say circling back to my dissertation

24:34

Has been really cool in terms of you know, thinking about

24:38

Personalization in a different way and then the other thing that I wrote in my abstract even more surprising

24:47

Was the recent connection I made between generative learning and generative AI

24:53

I mean that was something huge to me when I was studying at Penn State back in

24:59

1996

25:01

What's his name?

25:03

Whitrock, I believe was his name. He was I studied we read we read articles

25:08

for an author called Whitrock's in

25:11

1990 generative learning theory. He it's a theory

25:16

There was no AI at the time or at least not the AI that we know and now

25:20

So there was generative learning theory and then there was Weinstein's learning strategies model

25:26

well

25:26

I mean in the age of generative AI this is now making a lot of sense to me because I think about the concept of

25:33

Mind tools and I like to use technology as a companion as a mind tool

25:38

I like to use AI as a mind tool and to help me

25:42

To help me figure things out. So

25:45

My mentor David Jonathan who passed away in 2012

25:50

He was the one who introduced me to technology as a mind tool so that we can you know

25:56

Just like we use other tools in our

25:58

as humans to build things

26:02

Technology can also be looked at as a mind tool to help us learn and so

26:07

generative AI

26:10

You know, it's making me think of generative learning just like just like generative AI

26:17

Generates text from large language models. We as humans, you know can generate learning

26:25

from our experiences and from

26:29

our learning experiences with the help of

26:32

Generative AI so if we can customize if we can even you know

26:37

Build a customized version of chat GPT or co-pilot or whatever or Gemini or whichever, you know?

26:44

Gen AI tool you want if we can if we can teach our students how to

26:50

Create a personalized version of that Gen AI tool

26:55

To help them learn the way they learn best and their in corporate their interests sort of going back to you know

27:02

Personally relevant interests. I think that would be huge. I think it would be huge to have students and learners, you know

27:10

Understand how to customize the use of Gen AI tools for their own

27:15

Benefit in terms of you know using it as a mind tool to learn and as a lifelong learning tool

27:22

So I was engaged in this

27:25

Research proposal that we will have a center at George Mason University where we will

27:30

You know

27:32

We will we will use Gen AI we you know

27:37

We will customize Gen AI tools for students to become self-regulated learners because it's not easy

27:43

What I'm saying is not easy. I mean not every student or learner is able to

27:47

Figure things out on their own. That's why they need us as faculty and scaffolds to help them

27:54

But it's not easy

27:55

But if we can get them started to become self-regulated learners and you know

28:00

Evaluate their personal learning environments as they go through and figure out whether this is working for them. I think this would be

28:07

huge

28:09

Yeah, it's amazing to think through what could be possible there there's so much

28:23

You know

28:24

Personalized learning is such a big area

28:27

obviously of of interest I mean, but

28:31

what I'm kind of always curious about with

28:34

In the context of that in AI is you know right now?

28:40

I mean and maybe someday we'll see a different approach to these tools that will

28:43

Work differently, but AI is real good at reflecting back sentiment to you

28:51

or

28:53

Kind of what I would I cut I like to call like a creative mean where like it's sort of like

28:59

It takes it sucks all this content up and will deliver you some middle percentage thing something that's kind of

29:06

Acceptable and average and is you know, whatever that means obviously that is its own

29:11

can of worms but

29:14

I'm really curious to see

29:17

like I because I can see like the idea of

29:21

Personalized learning is like sure

29:22

Yeah, AI like a large language model can spit out like some questions or different variations on things

29:27

But what I'm really curious to hear about from and maybe I'm just not aware of the research too because I'm not necessarily looking at

29:34

journals every day, but

29:37

Has anyone been able to successfully

29:40

Use a tool like that to to personalize learning in a way that students find helpful

29:45

Or is it just is it a theory right now? It's been unproven so far. You know, I don't

29:50

Kind of yeah, I'm thinking about right now

29:52

Yeah, that's a good question. I mean, I

29:55

Don't have data to support. I know that

29:59

people in the corporate and workplace settings are

30:03

using it more like

30:05

Like a performance tool like to help them make their job more

30:11

Efficient or effective right? So we do have data on

30:16

on that I was at a

30:20

So so for example if you want to send

30:24

An email communication you can ask chat GPT to help you write that but I want to hear more about

30:31

your thoughts Taylor about

30:34

You said something that really resonated with me here is AI as a creative mean mean

30:40

But more AI as a reflective tool

30:43

how how do you see that because I think that ties a lot to my research on personal learning environments and

30:51

Self-regulated learning because if we can get learners to become

30:54

reflective and

30:56

evaluate their learning space and their digital learning space and you know figure out if they are actually

31:01

Achieving the learning outcomes and the goals that they want to achieve to become

31:07

Better employees or more efficient effective whatever or meaningful learning, you know

31:12

What how did you come up with that AI as a reflective?

31:16

- well to me, it's something that I'm interested in as a possibility. So one of the things

31:23

and and I'm it's on my brain a lot right now because

31:27

Later today. I have a session where I'm gonna be playing back a project where basically I interviewed an AI

31:35

I

31:36

About AI and education. So it's it's weird

31:39

it's a weird project but I wanted to do this because I wanted to come to terms with the tools a little bit and I

31:46

am

31:47

Interested in the possibilities of these things but also, you know

31:50

pessimistic about the business realities that tie them and and there's you know, there's plenty of things to be

31:56

You know or or or like the realities of how artists and musicians and there's a million things right

32:05

You don't necessarily need to go in

32:07

It's at it's at two o'clock one Eastern I believe

32:17

There'll be a recording of it too, but what I what I figured out though is

32:24

because I went into it thinking it would be a

32:29

Exercise in me asking kind of probing and critical questions and it being as an AI

32:34

Positive right about AI and its uses and it really wasn't I think

32:42

Because it picked up on my tone of the questions. I was writing immediately and mirrored that back to me

32:50

You know, I mean

32:51

Yeah, so but that's that's just this tool in the way. I prompted it, right and my point is though

32:59

Is so that was one thing that the more I did this project the more I was like, you know

33:04

It's it's reflecting my tone back to me

33:06

It's not it's it will and that's what I mean is it's not in that way right because I'm feeding it text that is

33:16

Tinge negative in some ways and so it's gonna respond to me negatively

33:21

And that that's that to me is something that could change right? This is how the tools work right now

33:26

it's how I use them, but that's sort of the my point is that like

33:30

the quality of the response is so reflective or so

33:34

Dependent on how you prompt it and I'm curious to see where

33:40

These things will go in a way where people can use them as reflective tools

33:44

They can because because I know people already do this though the layout an argument and say hey

33:49

Criticize this for me right and that can be a useful way to use a large language model

33:55

My problem is I didn't tell me I didn't tell it. Hey, I'm gonna ask you kind of negative questions

34:01

I want you to to go back at the questions and try to try to criticize my arguments

34:08

Because I didn't specifically tell it to do that. It's sort of commiserated, you know

34:12

it just seemed because I I was at the learning ideas conference at Columbia University in June and

34:19

The speaker I'm trying to remember which speaker

34:24

It was they think that prompt engineering is BS. Sorry, but I mean like they don't believe in prompt engineering

34:32

I mean since the AI came out everyone's talking about prompts and prompt engineering and it all depends on your prompt. So this

34:39

This guy I don't think it was Chris DeeDee, but it could have been he was the keynote speaker

34:46

You know, we are a Chris DeeDee from Harvard. Yeah Meredith has so um

34:50

He may have been him in prompt engineering is a marketing ploy the prompt changes every day

34:57

So the thing the same prompt you engineer will not yield the same answer

35:02

even if you typed in the same prompt and so

35:05

There's a ceiling on LLM's is what I guess they're trying to say, you know

35:10

it's not like you know, every time you you change the prompt you're gonna get a

35:15

different answer but going back to your point about

35:19

Yeah, I mean about it changing its tone that's that's pretty

35:25

That's that's I guess that's where that reflective maybe part comes in

35:31

for when we're using it as a mind tool with students or as a companion where

35:36

Students can really maybe use it to have it assess their learning. I don't know that yeah

35:44

You know, I think it could be used in that way, but I think folks would have to know

35:50

about the

35:51

The by the biases is not really the right word

35:54

But like the tendencies of the tool and how to set it up in a way

35:59

I agree. I I don't like I don't know much about like

36:03

Creating good prompts, but but you know your point on prompt engineering

36:08

Would you ever engineer something where you can't actually have visibility into what's below what you're engineering?

36:15

Like you wouldn't build a bridge on ground or

36:18

Over ground you haven't surveyed right or build a building is a better example, and I think that's a that's a good point

36:25

Yeah, and and I'm interested in that the the it you it's used as a reflective tool

36:30

But so far I've been a little underwhelmed and I am

36:33

curious about

36:36

You know if the large language model thing even has a path forward because it does seem like

36:41

You know two years ago. We're like wow imagine how good these things will be in a year, but I don't really think this

36:47

Line of generative AI is gonna get better in certain ways at least it will get better at certain things

36:53

But it's probably always gonna be bad at some of the things that's bad at right now at least yeah

36:57

But it's impressive that you were able that it had a tone as you're mentioning

37:01

And yeah, I guess yeah, that would be something we should do research on because you know when we're gonna use it more and more

37:08

It's important that you know to

37:12

Give you back a positive tone because if it gives you a negative tone it could you know it could affect your well-being it could

37:19

affect your mental health right and so

37:22

Yeah, so Chris Dede at that learning ideas conference. You know

37:27

Try to make the

37:31

the

37:34

Association between you know well AI is more like

37:38

You know the brain versus the mind like we humans

37:43

You know have the mind and the brain, but AI is kind of like just that brain the neural circuitry

37:50

So it's pulling from large language models, and he was like you know

37:54

Humans make are better at making judgments and decisions whereas AI is better at reckoning

38:02

I you know he made that distinction. I had to look up really what reckoning means, but I mean it's murky like you know

38:09

But he was trying to make a distinction because a lot of people are you know just saying you know

38:14

That AI is just gonna Wow like it's just it's just gonna

38:19

Disrupt our lives, and I don't know but he was like this is like the ninth

38:24

Hype cycle that we've had and they've been wrong for nine times

38:28

I mean you know what I forget what the other hype cycles were maybe I remember

38:33

Remember the 2000 where we had the Y to everything what was gonna happen then the whole Y2k?

38:41

Because everything was gonna change because we were gonna have two zeros at the end of the year and then everything was gonna like

38:48

All of our data systems were just gonna like and so he talked about we've gone through nine

38:55

Hype cycles for technology, and they've been wrong nine times. I I'm not sure I

39:01

Agree with him, but I'm just sharing and then he says you know LLM solve the natural language

39:08

processing problem

39:10

But AI is like a parrot capable of processing, but not comprehending

39:15

I mean you know that that's why I'm opting to think that maybe

39:22

You know that maybe

39:24

We can use AI as a mind tool because it's not gonna overpower us or it's not gonna like have all the answers for us

39:31

Because I want my learners

39:33

You know and when they when they design instructional systems. I want them to be able to you know

39:38

Generate their own content. I want them to be able to think through the design processes

39:44

I don't want AI to tell them

39:47

What to do so it's it's it's complex because when I like I'm teaching a course that starts in two weeks about

39:53

you know cognition and technology the intersection between the affordances and capabilities of learning technologies and and

40:02

our pedagogical sequences and cognitive

40:06

states of mind and learning preferences, etc

40:10

And so I asked actually

40:13

Chat GPT to generate learning outcomes for the course and it did an amazing job

40:19

I mean I've talked to score several times and I was like totally impressed with the learning outcomes and generated for the course

40:27

So so honestly, I I don't know. I mean, I don't know how powerful

40:31

these generative AI tools are but one thing that you said Taylor is

40:37

I

40:40

Think I also heard on NPR radio that

40:44

that

40:46

Large language models even here in Virginia where I live and you know

40:51

because of the processing speed when you ask chat GPT something and it

40:58

Processes it in like five milliseconds

41:01

the data centers that are pulling from those large language models are like

41:08

using so much power and electricity that it's not sustainable apparently and so

41:15

That is why like you said Taylor

41:19

We may need to move away from large language models and they talk about small language models

41:26

I don't know what small language maybe small language models are more like

41:29

more like

41:32

Customized, you know like by topic or customized so you it's only pulling from a limited

41:38

Dataset versus pulling from from large language models, right? So, you know anything about that?

41:46

I mean, yeah, I mean I know a little bit but

41:49

Like my understanding with the with the smaller language models is that essentially have less

41:57

Connections in their data set is one way to think about it. And so their their responses are

42:03

Average more to the again, I'll call it mean the center right the most likely response. You're less likely to get

42:12

Like interesting or outlier kind of responses in in those in those is one part of it and another part is

42:22

context window so like if you're if you're having a

42:26

if you want to use a small smaller language model and you're

42:30

Conversing with it right which and and one way I've heard this described to me

42:34

way like chat works in large language models is think of it like a

42:40

Like a like a pachinko machine like the ball with the pins, right?

42:44

you drop a ball down and it goes all the way to the bottom and

42:46

The model is where the pins are placed and the ball is the text that you've your your prompt

42:53

basically what you've put into it and when you you put in your prompt and you drop the ball down and something comes out right and

43:00

it's

43:01

Influenced heavily by the pins right and then when you ask it to follow up

43:06

So you say, you know, blah blah blah and it it responds and then you ask a follow-up question

43:12

You're submitting the entire history again. So you're submitting your first question its response and your follow-up question

43:19

And the longer you do that and so it's it's it you can think of it like autocomplete in that way, right?

43:25

Yeah, and so this is again something that I kind of learned or I guess saw demonstrated when doing this project

43:33

I was working on because I had a hard time keeping it on in the conversation context

43:38

until I figured out how to use the tool properly to do that and

43:42

So

43:45

So the smaller models have a smaller context window, which means they can't keep as much of your prompt in

43:51

Memory, and I don't mean memory in a computer sense. I mean memory and whatever AI

43:57

I actually don't know from a technical perspective what you call that. I keep hearing it called context window, but

44:03

Maybe I guess it might literally be memory from a computer perspective. But so that's that's one thing

44:09

I really think though that and I don't think this is great

44:13

I really wish the large companies that would do this with that are doing this with this huge environmental impact

44:19

Would not have done this

44:20

But I think that what they're banking on is that what we call large language models today in three years will be small and

44:27

They can run with low energy usage and on

44:31

Directly on your phone or something, right? We're seeing we're already seeing this with with

44:39

Stuff on Android and Apple is got their thing called Apple intelligence, which is coming out next year

44:45

or end of this year next year and it won't be as

44:49

Sophisticated as the like chat GPT 4o model

44:53

But it will be you know

44:55

It can do some it's a smaller version of something like that is my understanding. Obviously. I don't it's not out yet

45:03

So I but yeah, I think that's where they're banking on this

45:07

I think that is a very Silicon Valley way of doing it and I don't really appreciate it

45:13

But I can see their line of thinking

45:15

You know

45:17

But I mean, can I have like when I teach this course?

45:20

Can I can I create I guess I can I create a customized chat GPT?

45:26

Based on the content of my course only like I can feed it

45:30

Can I feed it the articles and the book that I want the students to read because I'm the expert on that topic

45:37

can I can I feed it the the readings that I want them to read and then the

45:43

I don't know some other content and and and then have them

45:47

Query that can I do that? Can I create a customized?

45:51

Chat GPT just for my course

45:54

Yeah, you you technically can and I I am less familiar with

45:59

the actual chat GPT like that that - of course I've used it but

46:05

Most of the stuff I've been using lately has been the open models like llama

46:09

And I don't I don't I'm not a heavy user of these things

46:12

But that is one that actually can run on your laptop with a program called Oh llama

46:17

And it's on my laptop not real fast. It's maybe not quite as good, but it does work

46:24

and

46:27

You can you know give some of those tools that the if the developers have set it up this way

46:32

Essentially access to a bunch of text that sort of gets added

46:36

Before your prompt if that makes sense. Yeah, and I my understanding is the chat GPT

46:42

Subscription lets you give it a library of documents too, but I don't actually use that

46:47

Yeah, I mean I also have to ask my university if they would allow me to do that because you know

46:52

Yeah, but doing that with an open model that can run on your computer locally. There are less

47:00

Problematic implications of that right because you're not actually sending

47:03

Yeah, then that doesn't work yeah, we I will also plug that we did a

47:11

Reclaimed TV stream a few weeks ago about this tool called open web UI and it's like that

47:19

But it runs on our cloud or or any cloud for that matter really, but it's it's local to that instance

47:25

So the the data doesn't leave

47:28

So if you could delete it at the end of the semester and it's gone. It's not been sent to Microsoft or whatever

47:32

So that could be something that you could use but you know, it's it's expensive to run those

47:39

I'm it's very clear to me that

47:42

Chat GPT and the alternatives are really heavily subsidized right now by a venture capital and stuff investment

47:50

Okay, so in closing and then I want to see if there are any questions in discord or what else is happening

47:57

I just want to say that again, you know going back to

48:00

Coming back full circle to personalized learning and how I'm trying to in generative learning and generative AI and

48:10

trying to figure out how to how to integrate all that and I want to say that you know, I

48:16

Just hate it when people say Oh technology is just a tool to me that is really really

48:26

not

48:27

Correct, because I believe that you know

48:30

Technology is

48:33

Has affordances and so technology shapes our socio-cultural practices and like I started, you know

48:42

Look, look what we're doing here, but it's really you know, we there's a famous saying I forget who said it

48:49

No, it's like, you know, we built our tools and then and then these tools in return shape our lives, right?

48:56

I mean, so we we you know, it's just like, you know

49:00

We make things we are tool builders as humans and we make things that change our lives

49:06

And so theory of affordances and Gibson is the big

49:11

Communications scholar who said, you know media is the message

49:16

So for example, if someone were to listen to me over video

49:20

They will get a different

49:24

impression or or learning experience than if they said they just listened to my talk over audio right because

49:31

The media is the message different media

49:35

different affordances and for learning and for teaching and for

49:40

Whatever so he was you know

49:44

he was big on on the theory of affordances and

49:51

So I want to emphasize that I think there is this reciprocal relationship between

49:56

you know between technology or the tools that we use and

50:01

Our knowledge or cognition and so we don't control technology and technology should not control us

50:08

But what was the theory of affordances as we we become what we behold?

50:12

We shape our tools and then our tools shape us in return. That was actually from Marshall McLuhan

50:19

Marshall McLuhan is the the huge communications

50:22

scholar I believe and

50:26

But then Gibson is the one who came up with the theory of affordances is that you know

50:32

Look what happened when we built cars and then cars shaped our everyday life and when you look at you know

50:38

The Industrial Revolution where we are right now

50:41

and so things evolve going back to how our field is evolving our field of instructional design is because

50:49

Mainly because of all these technologies that we build whether it's the Industrial Revolution

50:53

Whether it's airplanes whether it's cars whether it's instructional systems. All of these things are

51:00

Shaping after we use them. They are shaping the way we understand the way we communicate. So I just wanted to

51:07

emphasize that I'm a firm believer that technology is not just a tool that it is a

51:15

You know, it has its affordances and it it's it impacts hugely

51:20

our our instructional designs and therefore when we design

51:24

personalized learning experiences or whatever we're designing as instructional designers

51:29

we need to be aware of the affordances of the

51:34

Technologies or the platform that we're using and that's the course that I teach for my doctoral students

51:40

They have to do what we call an affordance analysis and there are you know, physical affordances

51:45

cognitive affordances

51:48

pedagogical affordances

51:50

So many different types of affordances negative affordances positive affordances false affordances

51:56

Hidden affordances. There's so many different types of affordances and what I engage my students to do is to do this

52:04

affordance analysis of a platform that they like whether it's an LMS or

52:09

WordPress or some type of technology and come up with all the list of affordances for that specific technology and then

52:16

Figure out what are the best affordances to capitalize on when they're designing instruction?

52:23

Okay, so I think

52:28

Do you want to ask a question kind of going back to your open?

52:32

learning environments or personal learning environments

52:36

Shannon mentioned in the in the chat a couple minutes ago about

52:40

finding it tricky to

52:43

See the line of matching students with their interests and ways they learn

52:46

but then also making sure to encourage them to push them outside of their comfort zone and

52:52

Wanted to see like in your experience if you have any like tips or tricks on how that might work or

52:59

How how you you've seen success in that or how you can kind of frame your your curriculum around that?

53:05

Right, so I have not actually

53:10

been able to

53:13

Have my students create their own personal learning environments because my university

53:18

wants me to use the LMS and so I

53:22

wish the LMS had a place in it where

53:27

So what I do is I have students create their own wikis

53:30

Which I believe is sort of a way to

53:33

Implement a PLE approach I have them create their own blog spaces within the LMS

53:41

So I've done that and that has been

53:45

Very successful. I do have some research papers on that

53:49

That Shannon might want to read

53:53

We did look at blogs and wikis and one more

53:57

Discussion boards I think as as technologies within LMS is that can support

54:04

students to build their own sort of digital space and

54:08

And reflective space where they can, you know reflect on their learning in the course

54:13

Yes, I do have a couple of articles where they could use those within the LMS

54:20

I've never I've had some colleagues for example create

54:24

Facebook pages for their courses. I have not done that but that's another way of implementing a PLE is that if you

54:32

If you create a Facebook page for your course and then allow students to create their own

54:38

personal learning networks within Facebook

54:42

Reach out to other learners kind of that goes back to my personalized learning interactions framework, which is in this book

54:48

That was just published in that framework

54:51

We have six types of interactions and I think I can overlay on that personal learning environments because students can you know?

54:59

Interact with other learners they can interact with coaches. They can interact with AI

55:03

Outside of your course, it doesn't have to be all

55:06

You know, that's a great question because when we think of a course with in higher ed we think you know

55:13

This is a closed space. That's it. That's my course it goes on for 15 weeks

55:17

These are the readings that they're doing

55:19

These are the students that they're interacting with a personal learning environment and a personal learning network opens it up

55:25

to a much larger network and allows

55:29

Students to interact have different types of interactions with different technologies and different people

55:36

Yeah, definitely

55:39

Awesome. Yeah

55:41

E-learning techie and the discord chat says that Facebook would so not fly where I am for privacy concerns. So

55:48

Can confirm on that side

55:52

Well, cool, well, yeah, thank you so much nada for this awesome discussion and Taylor for

56:00

Talking through all of the awesome stuff. We've got

56:05

Maren up next working through some

56:10

music streams for we've got a double hour or two hours of

56:15

lunchtime tunes

56:17

Coming up. So

56:19

Before that so maybe I'll do it at some other point, but thank you. This was great talking with you

56:30

I enjoyed having Taylor and you Meredith because that made it more, you know

56:34

Interactive and social and you know, we covered a lot of ground

56:37

But so this is gonna be recorded now and then I can have like you're gonna send me a link that

56:45

that has

56:47

the recording

56:49

We will share all of that

56:51

I am gonna pass it off to Maren and you're listening to DS 106 radio camp from here and we've got the tunes