5. What is a remote lab?
⢠Advantages: organizational, academical,âŚ.
⢠It is cheap because it can be shared among
different institutions.
⢠It is always available.
⢠It is powerful because the teacher can add all that
he wants
⢠The teacher can track everything done by the
user.Â
⢠Disadvantages.
6. Examples of remote labs
⢠WebLabâDeusto (Spain), VISIR (Sweden), iLAB
(USA), labShare (Australia), etc.
⢠WebLabâDeusto offers experiments with basic
analog circuits, basic digital circuits,Â
microcontrollers, robots, incubator,Â
Archimedesâ principleâŚ..
⢠WeblabâDeusto also offers the system to
schools, etc.
10. Data mining in WebLabâDeusto
⢠Tracking: who, when, where, how long, webÂ
browser, IP, what device, experiment, state of the
queue, FacebookâŚ. And the most important
⢠What commands were executed and with what
results
⢠The teacher can reproduce the session to see andÂ
analyze the profile of the user: knowledge andÂ
learning
⢠Since 2009 more than 55 000 sessions.
12. Analysis of the opinion survey
⢠At the end of the semester the students
answer to a survey with 18 questions.
⢠The first survey was designed on 2003 with 15Â
questions.
⢠In the year 2008â2009 the current survey was
designed merging the previous survey with
the results of the eMERGE project (Bordeaux)Â
and Ma&Nickerson.
13. Analysis of the opinion survey
Q1. WebLab helps me with the subject, the concepts, the exercises, projects, etc
Q2. Using the WebLab, I fell that it is real and it is not a simulation
Q3. It is a good idea to extend this WebLab to all the students
Q4. I have enjoyed using the WebLab
Q5. WebLab is easy to use
Q6. The quality of the WebCam is good
Q7. The different I/O devices (switches, buttons, etc.) are easy to use
Q8. I donât have problems with the assigned time
Q9. The I/O devices implemented are well selected
Q10. Even being far from the WebLab, I have felt that I control it
Q11. I would like to use the WebLab in others subjects
Q12. I am satisfied with the WebLab
Q16. The userâs manuals are good and clear.
Q17. I have been motivated by the WebLab to learn more about the subject
Q18. The WebLab is a high quality software (access, management, availability, etc.)
14. Analysis of the opinion survey
⢠Is it correct?Â
⢠Is it useful and meaningful?Â
⢠Does it contain information?
⢠For what is it being used by WebLabâDeusto?
⢠Learning analytics
15. Analysis of the opinion survey
⢠XâO:
â Experience
⢠The students use the weblab in a regular way in two
different subjects since 2008Â to 2012
â LP:Â Programmable logic (VHDL&CPLD)Â (123Â surveys)Â Third
year.
â DE:Â Electronics design (VHDL&FPGA)Â (73Â surveys)Â Fifth year.
â Opinion survey
⢠18 questions, Likert pseudoâscale with 5 levels
16. Analysis of the opinion survey
⢠Fiability
â Cronbachâs alfa
⢠Construct Validity
â Is there an internal consistency?
⢠Item analysis
â Homogeneity index
17. Analysis of the opinion survey
⢠FIABILITY
⢠Cronbachâs alfa
⢠Result for the survey: 0.78
⢠It is a medium to high value
19. Analysis of the opinion survey
⢠FIABILITY
â UTILITY Îą =Â 0,74
â USABILITY Îą =Â 0,64
â INMERSION Îą =Â 0,40
â OTHERS Îą =Â 0,27
⢠Looking to the last two values it seems that
these two factors do not exist
38. Learning evaluation
⢠OâXâO: Around 50 students of two different andÂ
similar groups âŚ. Analog electronics. 2012â2013
â Preâtest
⢠10 questions, multiple choice with 4 answers
â Activity/Treatment:Â 2Â weeks
⢠2 working sessions with VISIR in the classroom
⢠1 reviewing session
â Postâtest
⢠10 questions, multiple choice with 4 answers
⢠The same questions but in different order
41. Learning evaluation
⢠Cronbachâs alfa
⢠Result for the survey: 0,52
⢠It is a low value, but the results of the next
test are good. It means that the survey it is
not very good, so it should be improved.
42. Learning evaluation:Â Questions 1â5
P01 P02 P03 P04 P05
a 70 32 23 31 32
b 8 29 2 23 2
c 22 37 73 22 51
d 6 7 8 30 21
P01 P02 P03 P04 P05
a 34 12 12 12 13
b 6 12 0 6 1
c 9 25 38 9 25
d 5 5 4 27 15
P01 P02 P03 P04 P05
a 36 20 11 19 19
b 2 17 2 17 1
c 13 12 35 13 26
d 1 2 4 3 6
ALLÂ THEÂ TESTS
PREâTEST
POSTâTEST
43. Learning evaluation:Â Question 2
⢠In the circuit with two resistors of the same
value, the voltage in each resistor is:
A: it is equal, B: it is the half of E in each resistor
C: serial or paralell D: it is null
45. Learning evaluation:Â Questions 6â10
P06 P07 P08 P09 P10
a 46 9 35 18 10
b 17 19 18 41 18
c 34 57 3 27 10
d 9 21 50 20 67
P06 P07 P08 P09 P10
a 17 7 15 9 6
b 10 8 7 15 10
c 21 20 3 18 6
d 6 19 29 12 31
P06 P07 P08 P09 P10
a 29 2 20 9 4
b 7 11 11 26 8
c 13 37 0 9 4
d 3 2 21 8 36
ALLÂ THEÂ TESTS
PREâTEST
POSTâTEST
46. Learning evaluation:Â Question 7
⢠The total value of the resistor is:
A:Â close to 1Â kohm B:Â close to 100Â ohm
C:Â close to 10Â kohm D:Â power the circuit
49. Learning evaluation
⢠Difficulty index. The test is too difficult.
⢠We should redesign it.
Difficulty index Interpretation Recommended number of  items
< 0,25 Very difficukt 10%Â (1) 1
[0,25;Â Â 0,45) Difficult 20%Â (2) 5
[0,45;Â 0,55) Normal 40%Â (4) 1
[0,55; 0,75] Easy 20%Â (2) 3
>Â 0,75 Very easy 10%Â (1) 0
56. Learning evaluation
⢠The difference between groups is statisticallyÂ
significant:
â Paired tâtest, p < 0,001
Paired t-test
data: dfParelles[, 3] and dfParelles[, 2]
t = 4.9189, df = 51, p-value = 9.474e-06
â Wilcoxon test (rangos con signo), p < 0,001
Wilcoxon signed rank test with continuity correction
data: dfParelles[, 3] and dfParelles[, 2]
V = 825, p-value = 1.886e-05
57. Conclusion
⢠The survey designed to know the opinion ofÂ
the users is useful, but it is clearly and easily
improvable.
⢠The use of VISIR has a positive effect in the
studentsâ learning with basic electronics.
58. Future work
⢠Remote Labs + Learning Analytics
⢠Improve and redesign the survey for the users.
⢠Analyse the inmersion concept when using
remote labs.
⢠Extend the analysis of the VISIR effect in the
studentsâ learning.
⢠Better explotation of the available data: user
profiles, use profiles, session profiles
⢠Massive use of remote labs in MOOCs.
⢠Data mining.