![Wikipedia Wikipedia](/uploads/1/2/5/7/125795984/262918098.jpg)
Contoh Soal Tpa Bappenas S2 Pdf. 4/14/2017 0 Comments. Yang terkadang tidak seperti Bahasa Indonesia. Tes kuantitatif ini berfungsi mengukur kemampuan seseorang di bidang angka, dalam rangka berpikir terstruktur dan logis matematis. Sering- sering baca kolom- kolom di koran. Soal- soal bacaan/wacananya kebanyakan diambil dari sana. Jan 5, 2012 - Kemarin ini sempet cari soal dan conton soal untuk test GMAT S2, siapa tau ada yang perlu ini kumpulan contoh soal dan latihannya: 1. If Sally can paint a house in 4 hours, and John. Sama2 di cetak dan di edarkan oleh dan dari Bank Indonesia. Pada saat bers.
TES POTENSIAKADEMIK ( ACADEMIC APTITUDETEST) : INDONESIA' S EXPERIENCE
by
Sumadi Suryabrata
D OKUM ENTASI BAPPENAS
As,*
/sM/'oo(/re [email protected]
rengger| ...41 =..9.
The Overseas Tralnlng Offlce National Development Plannlng Agencles Government of Indonesia (BAPPENAS) November, 1988
TES POTEI{SI AKADEUTK (ACADEHIC APTITUDE TES?): I N D O N E S I A , SE X P E R I E N C E x )
he Jr r
Sunadi
Suryabrata
INTRODUCTIObI A- Baekqround The Repubiic of Indonesia is an island country of one people; iruncireci and ser;enty nillion the f ifth largesi eount,ry in the woridIt, proclaiuaed inciepencience in f945. As wii,h many its cieveloping eounE,ries, rapid acivances eciueacion, t,echnology, in produetion comnerce, agricuit,ural and inciustr.ial have occurred since inciepencience, particularly and the in iast twenty-five
In order to nainiain, continue, and acceierace these professionals advances, ever larger trained number of highly are neecied in ieaCership, acininisllstion.. and inplementaticn positions, notably in the higher eciucai,ion seciorIn response to ihis need been senciing government employees and Incionesia has university advaneed faculty nembers abroaci for training in graciuate programs. years, hundrecis of graciuate si,ucients in recent per year have been sent abroad- It is anticipatecj that the nuraber will increase into thousanrjs in the upeoming years. government present Llp lo have been no eentralizeci there policies preparaiion, piacement or procedures for the selection, processing, the overseas studenis. nonii,oring of and Ministries government and agenc ies acted inciepencient ly these have in procedures undertakings, s€lection As a result, anci scandards within across minisiries and even and agencies, ministries or year year, agencies, have been uneven. |iany of the from to snaller ministri-es and aE:encies have harcily been abie to sponsor prog:rans. advanced study is ineif icieni, The systen anc resulcs have been mixeci -
Presenteci at liay 30,
the NAFSA conference lgBB
in
iiashington
D-C
on
proficiency, language foreign that is concern A najor particularly has emerged as a maior criterion English, nay be unf air t'o those aff airs st,ate of This f or selection. remote places, and cities in. small enployees who are stationed language foreign or inprove their to naintain with no opportunity out of b e e n have eandidates proficienly. In many cases, potential of the usefulness years, reducing thus several for college t h e r e grades as a Predictor of graduate suecess. Further, college candidates to all fairly device applicable no selebtion has been is candidate or not to whether as decisions for use in naking it sTas urgent irain ing . Thus potent, ial l:r su it ab le f or graciuate be made that a deviee that could be used for such decj-sion-nakin$ cievice to neet the need wouid be The mosr appropriate availabie lncionesia (Indonesian rest in Bahasa a kind of aeadenic aptitude ianguaEre ) .
Overseas
TrainrnP
Office
here and other described conciiiions the to In response a new Unit e s t a b l i s h e d o f I n c i o n e s i a G o v e r n m e n t needs, the related ( B A P P E N A S)' carled A g e n c y P l a n n i n g Developnent National in the j-ts ( I { S C O T ) and T r a i n i n g Overseas for National Comnitree Off ice (0TO). Unj.t. Overseas Training operational The central
purposes
for
which
NSCOT and OT0 were set
uP
were: /1
+,/
4.,'
the formulation training;
of
nationaL
po1icies
on
overseas
priorities and training on of guidance the provision a g e n c i e s; funding bilateral and needs to i-nternational
(3)
development to national provision assistance of the overseas thei-r achieving and defining in agencies and obiectives; training
(4)
the
inplernentation
of
overseas
training
programs-
functions the poliey purPoses, the NSCOT perforns For these NSCOT, the arm of As the staff functions. and the OTO the staff issues which go beyond training and analyze OT0 needs to identify proiect. For exanpie, particular or the problens of any single of the slze and quality the with be concerned the OTO nust eannot be it pool of candidates training; of overseas national proiect. the P1aces in a single to fill eontent nerely
z
For this reason, the 0TO has developed a new t,est in Bahasa a foreign organized aptitude; to measure acadenic Indonesia and language training systenn which can be used by nany proiects, progirans which can help orientation developed cross-cultura] study in many countriescandidat,es prepare for nore effective T a.r @
Prrtenqi
Aizederni
lr
TPA was or t,est) aptitucie Tes Poiensi Ahadenik (academic The in late 1985. prociuced f or tine the f i-rst developed and on nationally adninistered was first first set, i.e., Form 1, Sinee then, TPA has gained Novenrber 30, 1985 to 944 candidates. private, public well as as fron many parties, recognition Forn 1of tets, Six sets well as international. national as on w a s a d n i n i s i ' e r ed F o r m l a s t T h e b e e n d e v e l o p e d . Forn 6, have a r e g u l a r o n B a s i c a l } y , c a n d i d a t e s 19BB to 3,139 Harch 26, y e a r l t o h o w e v e r , a t w i e e adninistered' schedule, the test is o u t s i d e s e r v i c e t h e n e e d w h i c h from aEiencies cater for requests test arranged sPecially addj-tional schedule, the regular p r o v i d e d . adninistra+-ions are also to t,he present a cycle 1985 up Fron August test by followed with test development, starting w ith e n d i n g and scoring, test administration, T e s t ing of the nnajor task have been the results, h as U n i t Unit of OT0. Another major task of the cieveiopnent.
of activities' printing, test test reporting and Selection been ltena bank
packages technieal of period three sane During the i r n provenent a n d to the developnent been devoted have assistance s erved as fron Indi-ana liniversity Dr. Danie1 J. Hueller of TPA. H e c o n t tibuted 1985. in Aqgust, consultant foreign the first Forn 1T P A of to the designing nany i-nportant ideas and concepts and in June 1986, to review the test He came for the second tine p a c k a g e of The third itprovide for improving reconmendations t h e by Dr. Janes E. Haxey fron was provided technical assistanee catne in August, of Iowa, who CoIlege Testing/University Anerican the i-e-, two maior parts, contained His reconmendations 1986. the and ( including equating) test TPA of improvement of TPAinstitutionallzation the Anerican and Dr. Haxey have contributed Dr - tlueller in It was decided that, perspective selection. and of testing the context' perspective added to be to this, another addition with eome fron eountries should new perspective the Ideally thus decided to It was eonditions sinilar to those of Indonesia. 'test test and developnent on study conduct t comparative Seven testing managenerrt systens' in ASEAN member countries.
institutions, two in Hanila, two j-n Bangkok, one in Kuala tunpur; Results of 1987. in early were visited and two in Singapore, to the TPA. t h i s s t u d y h a v e a d d e d s o m e ' A S E A Nf l a v o r '
in Indonesia of the TPA a validity,study validity To secure c o n d u c t ed' and another one i-n the. United Stales were also perj-od ciescribed year three the during activities The of TPA, p r e s e n t c o n d i t i o n s t o t h e c o n t r i b u ' u e d h a v e h e r e 1 y brief Sections' in the following be presented which will
II
TEST DEVELOPHENT A- Preoaratorv
Phase
both measurement t,eam of Psychologtsts, In August 1985 a O T0t ' h e t o c o n s u l t a n t s a s r e t a i n e d w a s I n d o n e s i a n , a n d Anerican a d v a n c ed a n o f j o b p l a n c o n s t r u c t i o n t h e i o r a w a s t o d e v e l o p The be w o u l d w h i c h I n d o n e s i a , i n B a h a s a t ' e s t a p t i t u d e acacienic ievel g r a d u a t e f o r c a n d i c i a t e s s e l e c i , i n g f o r d e v i c e aDDroDriat,e as a i T h e t e c h n i c a l . j o b w e l l a s a s d i p l o n a t i c w a s =l'avThe tean's i ' h e e x p l o r e w a s t o n i s s i o n p o i n t i c d i p i o n a t of the f ocala f o r e m e n t i o n e d t h e o f d e v e l o p i n g possibility and feasibility and nonninistries in sone governnent officials testInportant a gencies a n d m i n i s t r i e s t h o s e especialIy agencies, ninisterial o n n' lrere p r o g i r a n s o f t h e i r p r e p a r a t i o n and selection with active ( 1 ) t o a s s es the w e r e : v i s i t s p u r p o s e s 1hese of visited. The k ind of w h a t ( 2 ) o u t f i n d p r o j e c t , t o 1eve1 of support for the (3) to a n d a p p r o p r i a t e , m o s t or agency thought each ninistry test p r o g r a m s . a n d selection Preparation about the existing learl psychology nission, technical the out earry In order to especially universities, leading country's the at facuLties were Sone v i s i t e d AIso were visited. measurenent psychologists, ' m e a s u r e m e n t r.ationale T h e connunity'. the Indonesian nenbers of were described' construction plans for test the and tentative suPPort and both moral and behavioral were solicited, Suggestions were requested, and a tine were listed test conponents for Specifications over a five-year enterprise a kind of testing line for developing such an endeavor necessary for period was Resources specifiedand supplies, personnel, housing, including were itenized, test duplication test ' construction, test for equipnent and iten data processin$, iten analysis, scoring, adninistration, banking.
Test Construction visits and suggestj-ons the during Based on the diseussions test p e r s o n s tentative a v i s i t e d t h e o f by some , extended was t h e n s p e c i f i c a t i o n t e s t T h e was drawn. specification j-n two seninars: in the other and Yogyakarta one in presented
psychologists and menbers of t'he Jaharta, by measurenent attended in 'neasurenent Based on the discussions comnunity'. Indonesian in a nore or were nade, resulting the seminars some nodificalions less firn test speclfication. Form of the TPA was the first test specification, Fron this and Selection T e sting t h e T P A n e w s e t s o f d e v e l o p constructedTo (1) reviewing s t e p s : p r o e e e d s f o l l o w i n g t h r o u g h t h e Unit of OT0 (3) iten ( 2 ) w r i t i n g , i t e n test specif iation, and revj-sinEi ( 6 ) b anking, i i e n ( 5 ) ( 4 ) a n a l v s i s , iten review, test try-out, j t e n s t e s t,. t h e ( ? ) o f f o r u n i i n a l t i r e into and compilai,ion oi have needed only ninor revisionSo far, i,est specifications the need for change, the s u b s t a n t i ates Until enpirical evicience has writing such. Itern a s test specifications be retained will B e g i n n i n g U n i t . S e l e c t i o n a n d been done by menbers of the Testing b y w e r e d e v e l o p e d p o r t i o n i t e n s rrith Forn 5, a of the non-verbal i s a r c h i t e c t T h e U n i v e r s i t y . Mada Gadjah an architect fron Forms. for future itens the non-verbaf expected to contribute all be done by planned that iten review would It was originally Due to J a k a r t a . a n d p a n e l B a n d u n g , experts Yogyakarta, a fron iten t h e s o f a r h o w e v e r , reasons, some technical and budgetary and T e s t i n g o f t h e t h e s t a f f done by review has been sinplified, Seiection Unit unit did seleeiion and the Testing oui, the test, For trying p u t the it rather adninistration, a special test not arrange to the adninistered Forms test out ii,ems to be tried i-n the candidates the TPA. By so doing it has been not neeessary taking for the OTO to bear the cost of test try-outs. the for scoring the equipnent not have Since the OTO does data and perforning analysis, iten sheets, conducting answer and data processing, analysis, iten scoring, so far the Center, Scienee proeessing Conputer the by have been done the OTO that eventually University It is Planned of Indonesia. data and scanner own optical should have its Proeessing equipnent. has selection item analyses iten of Based on the results Jevel p nanely, iten difficulty been condueted. Two paraneters, and item discrirnination index r bis have been used in the Process (good) itens then have been Put of it,en selection. ,The selected done manually, now itern banking has been in the iten bank. Until yet for conputerized iten sinee there equipment available is no banking. conpilation For test security reasctns, forn beeh done by the final of the TPA has and Selection Unit.
5
j-nto the of items of Testing Chairnan
The activities have resulted in will be presenied
III.
Test described in this characi,eristics t,he present in the next section.
Developnent section of t,he TPA, whi:ch
TEST CHARACTERISTICS
Based on the activiries ciescribed in p r o c e s s e d coliecled t he and up to charact,eristics of the TPA are as f ol-lows.
Section i] present,
and data the test
A' TEST BLUE-PRINT The test biue-print unchanged fron the of TPA remains alnost .f irst ciesign. of three sublests, i -e . , The test consist,s stil] (a) verbal, (b) quantirative, This concept, reasoning. and (c) that is, that acadenic aptiiude of three main abilities consisis be which will is substanriated of faetor analysis, by the results (test described blue-print) later. A resune of rest specification is presented in Table I.
ITEH STATISTICS The test Potensj- Akademik on the developed based has been classical test theory or true-score urode]. This nodel- takes into parameters. p account and two difficulty level i. e. . iten ( in discrinrination T h e c o n p l e t,e r it TPA's case r bis . inciex ) p and average of discrimination average of p level index i Uis of each of the five sets of TPA, Forn 1 - Forn 5 and t,heir respective cornponents are presented in Table II Considering first Forn forn, the average of p leve] Fs the F o r m L, with e g u a l s t e s t , w h i l e 2, to .56, is a somewhat easy F p Forna 3, 4 , w i t h 4 4 , 4 2 , a n d . 4 5 f orn and Form 5 of .4L, respectively are a litt1e tests. difficult
TABLE BLUEPRI}IT OF THE TES POTE}ISI AKADEHIK SECTIONS
SUBTEST
I. .IIV E R B A LA B I L I T Y I I I .
rv.
TIHE ALLO}IED
NU},IBEROF ITEHS
25 VOCABULARY 25 SYNONYM-ANTONYH 25 VERBAL ANALOGIES 15 READINGCOMPREHET'ISION 60 HINUTES
II
SUANTITATIVE ABITITY
I. II. 1II. IV.
COUPUTATION N U H B E RS E R I E S SUANTITATIVE COHPARISON I I O R DP R O B L E M
?q otr. Dq. 1q
90
I. III.
REASONING ABILITY
II. III. IV.
F O R H A LL O G I C A L l_J REASONING R E A S O N I N G ANALYTICAL x) 15 SPATIAL REASONING X ) 2 5 A B S T R A C TR E A S O N I N G
70
TOTAL
x) NON-VERBAL.
60 MINUTES
250
60 I,IINUTES
180 MINUTES HOURS.
-a
TABLE
II
AVERAGE OF D I F F I C U L T Y LEVELS AND AVERAGE OF D I S C R I H I N A T I O N I N D I C E S O F T P A F O R H 1 , F O R H 2 , F O R H 3 , FORH 4 AND F O R H 5
FORM
SUBSTEST
P
blS
4
Verbal Quant ilai ive Reasoning Total
.43 .70 .56 .56
.49 .65
Verbal Quantitative Reasoning Total
.46 .44
.36
VerbaI Quan-uitat ive Reasoning Total
.41 .45 .44
Verbal Quantitative ReasoninE; Total
.38 .44 .44 .42
VerbaI Quantitat ive Reasoning Total
.46 .38 .50 .45
..+z c-')
?E
.31 - 4-L
.+o
ranEle of in the with a diffieulty level A test produee a which is slightly score distribution our need neets kind of distribution and this p a r t o f t h e d i s t r i b u t i o n . upper
qA
.31 .41 ?R
.36
-JD
aa aq.
.37
.JJ
.31 :37 .34
.50 wi}l .40 to positively skewed for selecting the
r1
TEST STATISTICS are two essential Test and test validity rel-iability characteristics are always the Therefore, they of any testand .prof essionalnain concern of organi-zations testing organizations - A group of professionals in the OTO have been trying the technical TPA satisfies to work hard so that standard with regard to test reliability and test validity. Teqt
@
Rel
i nhi
I i irz
Professional
to nake decisions i-nportant that test or above ) . This
stanciarcis require
that
when tests
are
used
it is as TPA is, -g0 high (preferablv is since reliabiiity directly of related lo error of neasurenent . The relationship reliabilit,y and error of measurement can be depicted as about individuals, be very reliability understandable is
=SDV1-r J- {-
where
SE
= standard
error
of
rneasurernent
M
SD
standrad test
deviation
of
test
scores
reliability
{-+
It would be clear fron this that the higher the relationship test reliability, the error of measurement will the }ower be, which neans the less will of naking, nistakes be the risk in a deeision based on the test seores -
The coefficients of reliability are presented in Table III -
of TPA Forn 1 - Forn 5
III
TABLE
C O E F F I C I E N T SO F R E L I A B I L I T Y O F T P A F O R H 1 , F O R H 2 , F O R H 3 , F O R H 4 , A N D F O R } ' I5
N U H B E RO F
SET OF
^rrn
VERB
TOTAL
SUANT
?Fnm^
FORH 1 FORM 2 FORH3 FORH3
944 1206 L7?,3
F O R H4 FORU5
1491
(usA) 2241
.78 .82 .82 .78
oq o?
.94
Rq . J.t
o4
Gq
.88
-t6 Rq
RA
.BB
g4 g4
of forn L, Form 2, and Form 3 for Coefficients of reliability However, they can be esti-nated the total test were not conputed, respective of their reliability the coeffieients of fron This over .90. will be the figures subtests, and nost likely of a stuciy using by the results argument is substantiated graciuate It United States. in the studying students Indonesian of reliability eoefficient that the can be observed in Table III in From data presented for the total test is -95, well over .90. fron the test the TPA, Table III it can be concluded then, that perspective, of a good reguirenent the satisfies reliability test.
2-
Test
Validiiv
validi-ty Test neasures what it is are three approaches based on content, construct. a.
Content
test the tc which extend the indicates there purported to neasure. Traditionally, (a) validity, that is, for tneasuring test (b) and (c) based on on criterion, based
validitv
professional is done through Content validition basically judgment regarding itens concept and test of test the validity through professionaf Validity of the concept of TPA was secured had been of test itens senninars in late 1985. Content validities had iten writing achieved through iten reviews, conciucted after been conpleted
10
vCr r4 iu 9 ! f fv r e r
ri
n n - p orlv J U . s 9qul - o d
rvrqqt r ul : ui Y d i f r r
Validity based cal-led critetionon criterion, usually a relai,ed validiiy, In importartt. is comnonly regarcied as the nost this regard what would be one usually in deciding has a problen the criterion for test validition. the criterion shouid Ideally, perfornance be -for future the TPA's case, academic or, perfornrance at kind of the graduate GPA. If this leve1, i.e-, criterion is not uses anoiher avaitable then one usually neasuring lnstrunent ciesigrred io measure the same psychorogical consi,ruct. At the nonent GPAs are not avaiiable for raost of ihe subjeccs who have rai
by
Sumadi Suryabrata
D OKUM ENTASI BAPPENAS
As,*
/sM/'oo(/re [email protected]
rengger| ...41 =..9.
The Overseas Tralnlng Offlce National Development Plannlng Agencles Government of Indonesia (BAPPENAS) November, 1988
TES POTEI{SI AKADEUTK (ACADEHIC APTITUDE TES?): I N D O N E S I A , SE X P E R I E N C E x )
he Jr r
Sunadi
Suryabrata
INTRODUCTIObI A- Baekqround The Repubiic of Indonesia is an island country of one people; iruncireci and ser;enty nillion the f ifth largesi eount,ry in the woridIt, proclaiuaed inciepencience in f945. As wii,h many its cieveloping eounE,ries, rapid acivances eciueacion, t,echnology, in produetion comnerce, agricuit,ural and inciustr.ial have occurred since inciepencience, particularly and the in iast twenty-five
In order to nainiain, continue, and acceierace these professionals advances, ever larger trained number of highly are neecied in ieaCership, acininisllstion.. and inplementaticn positions, notably in the higher eciucai,ion seciorIn response to ihis need been senciing government employees and Incionesia has university advaneed faculty nembers abroaci for training in graciuate programs. years, hundrecis of graciuate si,ucients in recent per year have been sent abroad- It is anticipatecj that the nuraber will increase into thousanrjs in the upeoming years. government present Llp lo have been no eentralizeci there policies preparaiion, piacement or procedures for the selection, processing, the overseas studenis. nonii,oring of and Ministries government and agenc ies acted inciepencient ly these have in procedures undertakings, s€lection As a result, anci scandards within across minisiries and even and agencies, ministries or year year, agencies, have been uneven. |iany of the from to snaller ministri-es and aE:encies have harcily been abie to sponsor prog:rans. advanced study is ineif icieni, The systen anc resulcs have been mixeci -
Presenteci at liay 30,
the NAFSA conference lgBB
in
iiashington
D-C
on
proficiency, language foreign that is concern A najor particularly has emerged as a maior criterion English, nay be unf air t'o those aff airs st,ate of This f or selection. remote places, and cities in. small enployees who are stationed language foreign or inprove their to naintain with no opportunity out of b e e n have eandidates proficienly. In many cases, potential of the usefulness years, reducing thus several for college t h e r e grades as a Predictor of graduate suecess. Further, college candidates to all fairly device applicable no selebtion has been is candidate or not to whether as decisions for use in naking it sTas urgent irain ing . Thus potent, ial l:r su it ab le f or graciuate be made that a deviee that could be used for such decj-sion-nakin$ cievice to neet the need wouid be The mosr appropriate availabie lncionesia (Indonesian rest in Bahasa a kind of aeadenic aptitude ianguaEre ) .
Overseas
TrainrnP
Office
here and other described conciiiions the to In response a new Unit e s t a b l i s h e d o f I n c i o n e s i a G o v e r n m e n t needs, the related ( B A P P E N A S)' carled A g e n c y P l a n n i n g Developnent National in the j-ts ( I { S C O T ) and T r a i n i n g Overseas for National Comnitree Off ice (0TO). Unj.t. Overseas Training operational The central
purposes
for
which
NSCOT and OT0 were set
uP
were: /1
+,/
4.,'
the formulation training;
of
nationaL
po1icies
on
overseas
priorities and training on of guidance the provision a g e n c i e s; funding bilateral and needs to i-nternational
(3)
development to national provision assistance of the overseas thei-r achieving and defining in agencies and obiectives; training
(4)
the
inplernentation
of
overseas
training
programs-
functions the poliey purPoses, the NSCOT perforns For these NSCOT, the arm of As the staff functions. and the OTO the staff issues which go beyond training and analyze OT0 needs to identify proiect. For exanpie, particular or the problens of any single of the slze and quality the with be concerned the OTO nust eannot be it pool of candidates training; of overseas national proiect. the P1aces in a single to fill eontent nerely
z
For this reason, the 0TO has developed a new t,est in Bahasa a foreign organized aptitude; to measure acadenic Indonesia and language training systenn which can be used by nany proiects, progirans which can help orientation developed cross-cultura] study in many countriescandidat,es prepare for nore effective T a.r @
Prrtenqi
Aizederni
lr
TPA was or t,est) aptitucie Tes Poiensi Ahadenik (academic The in late 1985. prociuced f or tine the f i-rst developed and on nationally adninistered was first first set, i.e., Form 1, Sinee then, TPA has gained Novenrber 30, 1985 to 944 candidates. private, public well as as fron many parties, recognition Forn 1of tets, Six sets well as international. national as on w a s a d n i n i s i ' e r ed F o r m l a s t T h e b e e n d e v e l o p e d . Forn 6, have a r e g u l a r o n B a s i c a l } y , c a n d i d a t e s 19BB to 3,139 Harch 26, y e a r l t o h o w e v e r , a t w i e e adninistered' schedule, the test is o u t s i d e s e r v i c e t h e n e e d w h i c h from aEiencies cater for requests test arranged sPecially addj-tional schedule, the regular p r o v i d e d . adninistra+-ions are also to t,he present a cycle 1985 up Fron August test by followed with test development, starting w ith e n d i n g and scoring, test administration, T e s t ing of the nnajor task have been the results, h as U n i t Unit of OT0. Another major task of the cieveiopnent.
of activities' printing, test test reporting and Selection been ltena bank
packages technieal of period three sane During the i r n provenent a n d to the developnent been devoted have assistance s erved as fron Indi-ana liniversity Dr. Danie1 J. Hueller of TPA. H e c o n t tibuted 1985. in Aqgust, consultant foreign the first Forn 1T P A of to the designing nany i-nportant ideas and concepts and in June 1986, to review the test He came for the second tine p a c k a g e of The third itprovide for improving reconmendations t h e by Dr. Janes E. Haxey fron was provided technical assistanee catne in August, of Iowa, who CoIlege Testing/University Anerican the i-e-, two maior parts, contained His reconmendations 1986. the and ( including equating) test TPA of improvement of TPAinstitutionallzation the Anerican and Dr. Haxey have contributed Dr - tlueller in It was decided that, perspective selection. and of testing the context' perspective added to be to this, another addition with eome fron eountries should new perspective the Ideally thus decided to It was eonditions sinilar to those of Indonesia. 'test test and developnent on study conduct t comparative Seven testing managenerrt systens' in ASEAN member countries.
institutions, two in Hanila, two j-n Bangkok, one in Kuala tunpur; Results of 1987. in early were visited and two in Singapore, to the TPA. t h i s s t u d y h a v e a d d e d s o m e ' A S E A Nf l a v o r '
in Indonesia of the TPA a validity,study validity To secure c o n d u c t ed' and another one i-n the. United Stales were also perj-od ciescribed year three the during activities The of TPA, p r e s e n t c o n d i t i o n s t o t h e c o n t r i b u ' u e d h a v e h e r e 1 y brief Sections' in the following be presented which will
II
TEST DEVELOPHENT A- Preoaratorv
Phase
both measurement t,eam of Psychologtsts, In August 1985 a O T0t ' h e t o c o n s u l t a n t s a s r e t a i n e d w a s I n d o n e s i a n , a n d Anerican a d v a n c ed a n o f j o b p l a n c o n s t r u c t i o n t h e i o r a w a s t o d e v e l o p The be w o u l d w h i c h I n d o n e s i a , i n B a h a s a t ' e s t a p t i t u d e acacienic ievel g r a d u a t e f o r c a n d i c i a t e s s e l e c i , i n g f o r d e v i c e aDDroDriat,e as a i T h e t e c h n i c a l . j o b w e l l a s a s d i p l o n a t i c w a s =l'avThe tean's i ' h e e x p l o r e w a s t o n i s s i o n p o i n t i c d i p i o n a t of the f ocala f o r e m e n t i o n e d t h e o f d e v e l o p i n g possibility and feasibility and nonninistries in sone governnent officials testInportant a gencies a n d m i n i s t r i e s t h o s e especialIy agencies, ninisterial o n n' lrere p r o g i r a n s o f t h e i r p r e p a r a t i o n and selection with active ( 1 ) t o a s s es the w e r e : v i s i t s p u r p o s e s 1hese of visited. The k ind of w h a t ( 2 ) o u t f i n d p r o j e c t , t o 1eve1 of support for the (3) to a n d a p p r o p r i a t e , m o s t or agency thought each ninistry test p r o g r a m s . a n d selection Preparation about the existing learl psychology nission, technical the out earry In order to especially universities, leading country's the at facuLties were Sone v i s i t e d AIso were visited. measurenent psychologists, ' m e a s u r e m e n t r.ationale T h e connunity'. the Indonesian nenbers of were described' construction plans for test the and tentative suPPort and both moral and behavioral were solicited, Suggestions were requested, and a tine were listed test conponents for Specifications over a five-year enterprise a kind of testing line for developing such an endeavor necessary for period was Resources specifiedand supplies, personnel, housing, including were itenized, test duplication test ' construction, test for equipnent and iten data processin$, iten analysis, scoring, adninistration, banking.
Test Construction visits and suggestj-ons the during Based on the diseussions test p e r s o n s tentative a v i s i t e d t h e o f by some , extended was t h e n s p e c i f i c a t i o n t e s t T h e was drawn. specification j-n two seninars: in the other and Yogyakarta one in presented
psychologists and menbers of t'he Jaharta, by measurenent attended in 'neasurenent Based on the discussions comnunity'. Indonesian in a nore or were nade, resulting the seminars some nodificalions less firn test speclfication. Form of the TPA was the first test specification, Fron this and Selection T e sting t h e T P A n e w s e t s o f d e v e l o p constructedTo (1) reviewing s t e p s : p r o e e e d s f o l l o w i n g t h r o u g h t h e Unit of OT0 (3) iten ( 2 ) w r i t i n g , i t e n test specif iation, and revj-sinEi ( 6 ) b anking, i i e n ( 5 ) ( 4 ) a n a l v s i s , iten review, test try-out, j t e n s t e s t,. t h e ( ? ) o f f o r u n i i n a l t i r e into and compilai,ion oi have needed only ninor revisionSo far, i,est specifications the need for change, the s u b s t a n t i ates Until enpirical evicience has writing such. Itern a s test specifications be retained will B e g i n n i n g U n i t . S e l e c t i o n a n d been done by menbers of the Testing b y w e r e d e v e l o p e d p o r t i o n i t e n s rrith Forn 5, a of the non-verbal i s a r c h i t e c t T h e U n i v e r s i t y . Mada Gadjah an architect fron Forms. for future itens the non-verbaf expected to contribute all be done by planned that iten review would It was originally Due to J a k a r t a . a n d p a n e l B a n d u n g , experts Yogyakarta, a fron iten t h e s o f a r h o w e v e r , reasons, some technical and budgetary and T e s t i n g o f t h e t h e s t a f f done by review has been sinplified, Seiection Unit unit did seleeiion and the Testing oui, the test, For trying p u t the it rather adninistration, a special test not arrange to the adninistered Forms test out ii,ems to be tried i-n the candidates the TPA. By so doing it has been not neeessary taking for the OTO to bear the cost of test try-outs. the for scoring the equipnent not have Since the OTO does data and perforning analysis, iten sheets, conducting answer and data processing, analysis, iten scoring, so far the Center, Scienee proeessing Conputer the by have been done the OTO that eventually University It is Planned of Indonesia. data and scanner own optical should have its Proeessing equipnent. has selection item analyses iten of Based on the results Jevel p nanely, iten difficulty been condueted. Two paraneters, and item discrirnination index r bis have been used in the Process (good) itens then have been Put of it,en selection. ,The selected done manually, now itern banking has been in the iten bank. Until yet for conputerized iten sinee there equipment available is no banking. conpilation For test security reasctns, forn beeh done by the final of the TPA has and Selection Unit.
5
j-nto the of items of Testing Chairnan
The activities have resulted in will be presenied
III.
Test described in this characi,eristics t,he present in the next section.
Developnent section of t,he TPA, whi:ch
TEST CHARACTERISTICS
Based on the activiries ciescribed in p r o c e s s e d coliecled t he and up to charact,eristics of the TPA are as f ol-lows.
Section i] present,
and data the test
A' TEST BLUE-PRINT The test biue-print unchanged fron the of TPA remains alnost .f irst ciesign. of three sublests, i -e . , The test consist,s stil] (a) verbal, (b) quantirative, This concept, reasoning. and (c) that is, that acadenic aptiiude of three main abilities consisis be which will is substanriated of faetor analysis, by the results (test described blue-print) later. A resune of rest specification is presented in Table I.
ITEH STATISTICS The test Potensj- Akademik on the developed based has been classical test theory or true-score urode]. This nodel- takes into parameters. p account and two difficulty level i. e. . iten ( in discrinrination T h e c o n p l e t,e r it TPA's case r bis . inciex ) p and average of discrimination average of p level index i Uis of each of the five sets of TPA, Forn 1 - Forn 5 and t,heir respective cornponents are presented in Table II Considering first Forn forn, the average of p leve] Fs the F o r m L, with e g u a l s t e s t , w h i l e 2, to .56, is a somewhat easy F p Forna 3, 4 , w i t h 4 4 , 4 2 , a n d . 4 5 f orn and Form 5 of .4L, respectively are a litt1e tests. difficult
TABLE BLUEPRI}IT OF THE TES POTE}ISI AKADEHIK SECTIONS
SUBTEST
I. .IIV E R B A LA B I L I T Y I I I .
rv.
TIHE ALLO}IED
NU},IBEROF ITEHS
25 VOCABULARY 25 SYNONYM-ANTONYH 25 VERBAL ANALOGIES 15 READINGCOMPREHET'ISION 60 HINUTES
II
SUANTITATIVE ABITITY
I. II. 1II. IV.
COUPUTATION N U H B E RS E R I E S SUANTITATIVE COHPARISON I I O R DP R O B L E M
?q otr. Dq. 1q
90
I. III.
REASONING ABILITY
II. III. IV.
F O R H A LL O G I C A L l_J REASONING R E A S O N I N G ANALYTICAL x) 15 SPATIAL REASONING X ) 2 5 A B S T R A C TR E A S O N I N G
70
TOTAL
x) NON-VERBAL.
60 MINUTES
250
60 I,IINUTES
180 MINUTES HOURS.
-a
TABLE
II
AVERAGE OF D I F F I C U L T Y LEVELS AND AVERAGE OF D I S C R I H I N A T I O N I N D I C E S O F T P A F O R H 1 , F O R H 2 , F O R H 3 , FORH 4 AND F O R H 5
FORM
SUBSTEST
P
blS
4
Verbal Quant ilai ive Reasoning Total
.43 .70 .56 .56
.49 .65
Verbal Quantitative Reasoning Total
.46 .44
.36
VerbaI Quan-uitat ive Reasoning Total
.41 .45 .44
Verbal Quantitative ReasoninE; Total
.38 .44 .44 .42
VerbaI Quantitat ive Reasoning Total
.46 .38 .50 .45
..+z c-')
?E
.31 - 4-L
.+o
ranEle of in the with a diffieulty level A test produee a which is slightly score distribution our need neets kind of distribution and this p a r t o f t h e d i s t r i b u t i o n . upper
qA
.31 .41 ?R
.36
-JD
aa aq.
.37
.JJ
.31 :37 .34
.50 wi}l .40 to positively skewed for selecting the
r1
TEST STATISTICS are two essential Test and test validity rel-iability characteristics are always the Therefore, they of any testand .prof essionalnain concern of organi-zations testing organizations - A group of professionals in the OTO have been trying the technical TPA satisfies to work hard so that standard with regard to test reliability and test validity. Teqt
@
Rel
i nhi
I i irz
Professional
to nake decisions i-nportant that test or above ) . This
stanciarcis require
that
when tests
are
used
it is as TPA is, -g0 high (preferablv is since reliabiiity directly of related lo error of neasurenent . The relationship reliabilit,y and error of measurement can be depicted as about individuals, be very reliability understandable is
=SDV1-r J- {-
where
SE
= standard
error
of
rneasurernent
M
SD
standrad test
deviation
of
test
scores
reliability
{-+
It would be clear fron this that the higher the relationship test reliability, the error of measurement will the }ower be, which neans the less will of naking, nistakes be the risk in a deeision based on the test seores -
The coefficients of reliability are presented in Table III -
of TPA Forn 1 - Forn 5
III
TABLE
C O E F F I C I E N T SO F R E L I A B I L I T Y O F T P A F O R H 1 , F O R H 2 , F O R H 3 , F O R H 4 , A N D F O R } ' I5
N U H B E RO F
SET OF
^rrn
VERB
TOTAL
SUANT
?Fnm^
FORH 1 FORM 2 FORH3 FORH3
944 1206 L7?,3
F O R H4 FORU5
1491
(usA) 2241
.78 .82 .82 .78
oq o?
.94
Rq . J.t
o4
Gq
.88
-t6 Rq
RA
.BB
g4 g4
of forn L, Form 2, and Form 3 for Coefficients of reliability However, they can be esti-nated the total test were not conputed, respective of their reliability the coeffieients of fron This over .90. will be the figures subtests, and nost likely of a stuciy using by the results argument is substantiated graciuate It United States. in the studying students Indonesian of reliability eoefficient that the can be observed in Table III in From data presented for the total test is -95, well over .90. fron the test the TPA, Table III it can be concluded then, that perspective, of a good reguirenent the satisfies reliability test.
2-
Test
Validiiv
validi-ty Test neasures what it is are three approaches based on content, construct. a.
Content
test the tc which extend the indicates there purported to neasure. Traditionally, (a) validity, that is, for tneasuring test (b) and (c) based on on criterion, based
validitv
professional is done through Content validition basically judgment regarding itens concept and test of test the validity through professionaf Validity of the concept of TPA was secured had been of test itens senninars in late 1985. Content validities had iten writing achieved through iten reviews, conciucted after been conpleted
10
vCr r4 iu 9 ! f fv r e r
ri
n n - p orlv J U . s 9qul - o d
rvrqqt r ul : ui Y d i f r r
Validity based cal-led critetionon criterion, usually a relai,ed validiiy, In importartt. is comnonly regarcied as the nost this regard what would be one usually in deciding has a problen the criterion for test validition. the criterion shouid Ideally, perfornance be -for future the TPA's case, academic or, perfornrance at kind of the graduate GPA. If this leve1, i.e-, criterion is not uses anoiher avaitable then one usually neasuring lnstrunent ciesigrred io measure the same psychorogical consi,ruct. At the nonent GPAs are not avaiiable for raost of ihe subjeccs who have rai