Building the Turkish Discourse Bank

Transkript

1 Middle East Technical University Building the Turkish Discourse Bank Deniz Zeyrek and Cem Bozşahin Cognitive Science, Informatics Institute, METU, Ankara PDTB 2012 Workshop, April 30-May , IRCS, University of Pennsylvania Joint work with Işın Demirşahin, Ayışığı B. Sevdik-Çallı, İhsan Yalçınkaya, Ümit Deniz Turan, Ruken Çakıcı, Hale Balaban-Ögel, Berfin Aktaş

2 Outline PDTB-style annotation Which complex dependencies discovered The prospects 4/30/12 2

3 PDTB style annotation (Prasad et al., 2008) Guidelines (a set of explicit connectives to annotate) Discourse use of connectives Abstract object criterion (Asher, 1993) predicate-argument structure (Arg1-Arg2- Conn) Minimality principle 4/30/12 3

4 Turkish Discourse Bank (TDB): first release February, annotations on ~400,000 wordcorpus METU Turkish Corpus: ~2 million words Can be requested from: includes raw text files, annotation files, annotation guidelines, and a browser 4/30/12 4

5 The tagset Conn Arg1 Arg2 Supp1 Supp2 Shared Shared supp Mod Connective First argument of the connective Second argument of the connective Supplement to the first argument Supplement to the second argument The subject, object or adverbial phrase shared by a relation Supplement for the shared material Modifier of the connective or the modifier of the relation 4/30/12 5

6 Annotation and browser tools Annotation tool produces XML files as annotation data uses stand-off annotation method Browser supports regexp search across files connective-arg visualization 4/30/12 6

7 The browser: search facility 4/30/12 7

8 The browser: advanced search facility 4/30/12 8

9 Markables Coordinating conjunctions Subordinators complex subordinators (için for, karşın although, despite ) simplex subordinators, i.e. converbs (-IncA when, ken while, now that ) Discourse adverbials 4/30/12 9

10 A simplex subordinator: -den since Arg2-Conn-Arg1 Ne kadar üzüleceğini bil-diğ-im-den, How much you would worry I knew-dık- Agr-Conn, yarına erteledim yolculuğumu. I postponed my journey for tomorrow. 4/30/12 10

11 A complex subordinator: kadar until (two-part connectives) Arg2-Conn-Arg1 Gergin gövdemi uykulu bir karanlığın içinde hafiflemiş, erimiş duy-unca-ya kadar bekledim. I waited until I felt-conn-dat my stressed body relaxing and melting in darkness. 4/30/12 11

12 Word-order flexibility: the shared tag Arg2-Conn-Arg1 Sınırlı olmasına rağmen {bu devrimci kongreler}, sarayın değil, halkın demokratik ihtilalinin eseriydiler. Despite the fact that they were limited, {these revolutionist congresses}were not a result of the empire but the people s democratic rebellion. 4/30/12 12

13 Annotation procedure The regexp search returns various uses of one root neden reason returns: subordinator tokens: V-mEsI neden-iy-le reason+poss+ins ( V-NOM due to ) phrasal expressions: neden-le reason+ins - (as in bu nedenle due to this ) POSS: possessive INS: instrumental NOM: nominalizing suffix 4/30/12 13

14 77 connective tokens searched 143 connectives (types) annotated including phrasal expressions 4/30/12 14

15 Agreement statistics: Krippendorff s alpha (word boundary) Arg1 Arg2 ama but coordinating conj. ne.. ne neither.. nor için due to, in order to subordinator amacıyla for the purpose of böylece thus discourse adverbial tersine on the contrary /30/12 15

16 Nominalizations as arguments clauses based on the factive nominalizer DıK and the nonfactive nominalizer ACAK, clauses based on the infinitives MA or MAK clauses formed on the nonfinite nominal marker ış (Csató, 1998:230). 4/30/12 16

17 Total number of annotations Coordinating Conjunction Subordinating Conjunction Discourse Adverbial Phrasal Expression Total Single Parallel Total Tokens Relations Tokens Relations Tokens Relations Tokens Relations Tokens Relations /30/12 17

18 Dependency configurations We found 8 dependency configurations between connectives and their arguments (Aktaş et al. 2010, a la Lee et al. 2006). One pattern (nested relation) seems novel. 4/30/12 18

19 Types of dependencies in discourse (Lee et al. 2006) Tree-structured independent relations full embedding Non-tree structured shared argument properly contained argument properly contained relation nested relations pure crossing 4/30/12 19

20 1. Independent Relations {Köpekler} bahçenin öbür tarafında olmalarına rağmen (1) havlamaya başlamışlardı. Zincirleri çözülmemişti, ama (2) her an koparabilirlerdi. Although (1) on the other side of the garden, {the dogs} had started to bark. (Their) chains were not loose, but (2) (they) could break (them) any minute now. 4/30/12 20

21 2. Full Embedding İlgisizliğim seni şaşırtabilir ama (1) üvey babamı görmek istemediğim için (2) yıllardır o eve gitmiyorum. My lack of interest might surprise you but (1) since (2) I don't want to see my step father, I haven't been to that house for years. ama but (1) Arg1: my lack.. you Arg2: since.. years için since (2) Arg1: I don t.. father Arg2: I haven t.. years 4/30/12 21

22 3. Shared Argument Çevremde, o an duygularımdaki kargaşa yüzünden sahiplerini seçemediğim gülüşmeler oldu. Sonra (1) babam da güldü. Ama (2) onunkisi keyifli, neredeyse övünçlü bir gülüştü. There were laughs whose owners I could not identify due to my emotional turmoil at the time. Then (1) my father laughed too. But (2) his was a joyful, almost a boastful laugh. sonra then (1) Arg1: there were.. Tme Arg2: my father laugh but ama (2) Arg1: then my too Arg2: his was.. laugh 4/30/12 22

23 4. Properly Contained Argument Kapıdan girdi ve (1) söyler misin, hiç etkilenmedin mi yazdıklarından? dedi. Tersine (2), çok etkilendim. She entered through the door and (1) asked Tell me, are you not touched at all by what he wrote?. On the contrary (2), I am very much affected. ve and (1) Arg1: she entered..door Arg2: asked wrote? tersine on the contrary (2) Arg1: are you..wrote? Arg2: I am.. affected 4/30/12 23

24 5. Properly Contained Relation Proleterya devrimi, kapitalizmin en fazla geliştiği (dolayısıyla (2) toplumsal çelişkilerin en keskin olduğu) yerde gündeme gelir ve (1) devrim tek ülkede değil Avrupa çapında olanaklıdır. The proletarian revolution is likely to emerge in places where capitalism is highly developed (thus (2) social conflicts are the sharpest), and (1) the revolution is not likely to happen in a single country, but across Europe. ve and (1) Arg1: the proletarian sharpest Arg2: the revolution Europe dolayısıyla thus (2) Arg1: the proletarian developed Arg2: the social sharpest 4/30/12 24

25 6. Nested Relations Ben de sahiplerim açısından şanslı kedilerden sayılırım. Hem iyi baktılar hem de (2) kediliğimden özveride bulunmamı, özgürlüğümü satmamı hiç istemediler. Ama (1) her kedi bizim kadar şanslı olmayabilir. I am also one of the lucky cats in terms of my owners. They both took good care of me and (2) didn t demand that I let go of my cathood and sell out my freedom. But (1) not all cats may be as lucky as we are. but ama (1 ) Arg1: I am.. owners Arg2: not all we are hem... hem de both and (2) Arg1: they.. me Arg2: didn t freedom 4/30/12 25

26 7. Pure Crossing Sonra ansızın sesler gelir. Ayak sesleri. Birilerinin ya işi vardır, aceleyle yürürler, ya koşarlar. O zaman (1) kız katılaşır ansızın. Oğlan da katılaşır ve (2) her koşunun gizli bir isteği var. Bunu biz bilemeyiz. Then suddenly there are voices. Footsteps. People must be running errands, walking in a hurry or running. Then (1) all of a sudden the girl freezes. The boy also freezes, and (2) each run ought to have a secret wish. That we cannot know. o zaman then (1) Arg1: then suddenly voices Arg2: all of a freezes and ve (2) Arg1: people running Arg2: each run wish 4/30/12 26

27 8. Partial Overlap Schily'nin Ankara'yı Haziran'da ziyaret etmesi planlanmış, ancak Türkiye'de ölüm cezasının o tarihte henüz kaldırılmamış olması nedeniyle (1) sürdürülen teknik müzakerelerde ilerleme sağlanamamış ve (2) ziyaret ertelenmişti. It was planned that Schily would visit Ankara on June 20-21, however, since (1) capital punishment had not been not abolished then in Turkey, no progress could be made in the ongoing technical debates, and (2) the visit was postponed. nedeniyle since (1) Arg1: capital debates Arg2: no progress debates and ve (2) Arg1: it was planned debates Arg2: the visit.. postponed 4/30/12 27

28 Summary TDB uses PDTB guidelines It annotates: explicit connectives nominalizations as arguments phrasal expressions shared tag 4/30/12 28

29 Shared arguments, nested relations and partially overlapping argument configurations are quite frequent we cannot appeal to discourse notions like anaphora, attribution or a parenthetical genuine discourse structures? 4/30/12 29

30 Prospects the role of lexical relations frequency of types of complex dependencies genre-complex dependencies superimposed structures? centers (proved very useful for discourse use of pro-drop) 4/30/12 30

31 Ongoing & future work sense annotation data mining 4/30/12 31

32 Thank you. 4/30/12 32

33 Bibliography Asher, N. (1993). Reference to Abstract Objects in Discourse. Kluwer Academic Publishers. Aktaş, B., Bozşahin, C., and Zeyrek, D. (2010). Discourse Relation Configurations in Turkish and an Annotation Environment. In Proceedings of the Fourth Linguistic Annotation Workshop (LAW IV). Csató, Éva Á. (1988). Turkish. In Lars Johanson and Éva Á. Csató, editors. (1998). The Turkic Languages (Routledge Language Family Series), pages , Routledge, London. Alan Lee, Rashmi Prasad, Aravind Joshi, Nikhil Dinesh and Bonnie Webber. (2006). Complexity of dependencies in discourse. In Proceedings of the 5th InternationalWorkshoponTreebanksand Linguistic Theories. Christian Lehmann (1988). Towards a typology of clause linkage. In John Haiman and Sandra A. Thompson, editors. Clause Combining in Grammar and Discourse, pages , John Benjamins Publishing, Amsterdam; Philadelphia. Prasad, R., Dinesh, N., Lee, A., Miltsakaki, E., Robaldo, L., Joshi, A., and Webber, B. (2008). The Penn Discourse Treebank 2.0. In Proceedings of the Sixth International Conference on Language Resources and Evaluation. (LREC 08). 4/30/12 33

34 Back-up slides 4/30/12 34

35 Breakdown 4/30/12 35

36 Krippendorf s alpha (boundary approach) 4/30/12 36

37 Most frequent 5 explicit connectives in TDB and the frequency of their non-discourse use Discourse connectives Other uses Total instances Conn # % # % # % ve and için because ama but sonra later ancak however /30/12 37

38 The connective için Goal driven inf ( mak) için 510 ma POSS AGR için 239 ma için 6 Iş POSS AGR için 6 Iş için 2 Im POSS AGR için 7 Goal Total 770 Cause driven diği AGR için 276 (A)cAğI AGR için 12 Cause total 288 İçin total /30/12 38

39 Phrasal expressions functionality of the annotation tool the deictic element is the second argument of the expression morphologically similar to the second argument of a subordinator 4/30/12 39

40 Subordinator İhaleli sisteme geç-iş-in ardından bu ihalelere katılmayan 10 kadar firma takibe alındı. After the shift [shift-iş-gen] to the bidding system, legal action was taken against circa 10 firms that did not undertake bidding processes. Phrasal Expression after the shift [shift-nom- GEN] Bu-nun ardından After this [this-gen] 4/30/12 40

41 Nominalizing suffixes için V-NOM-(POSS)-(AGR) in order to (goal-driven) due to (purpose-driven) -ME or MAK -DıK NOM: nominalizaton POSS: possessive AGR: person agreement 4/30/12 41

42 The distribution of genres in METU Turkish Corpus and Turkish Discourse Bank THE MTC THE TDB Genre # % # % Novel Story Research/Survey Article Travel Interview Memoir News Total /30/12 42

43 Some examples of annotated connectives Subodinators Phrasal expressions Other (discourse adverbials, parallel connectives) amaç- goal (to this aim) amacıyla, amaçla bu amaçla dolayı- due to; because (due to) dolayı, dolayısıyla, dolayısı ile bundan dolayı, bu sebepten dolayı neden- reason (because) nedeniyle, nedeni ile bu nedenle, o nedenle, bu nedenlerle, yukarıdaki nedenlerle sonuç- result (as a result) sonucunda bunun sonucunda, bunların sonucunda, sonuç olarak, sonuçta zaman- time (when; then) zaman bir zamanda, aynı zamanda, o zaman, bir zamanda, ne zaman o zaman 4/30/12 43