This paper demonstrates that metre is a privileged indicator of authorialstyle in classical Latin hexameter poetry. Using only metrical features,pairwise classification experiments are performed between 5 first-centuryauthors (10 comparisons) using four different machine-learning models. Theresults showed a two-label classification accuracy of at least 95% with samplesas small as ten lines and no greater than eighty lines (up to around 500words). These sample sizes are an order of magnitude smaller than thosetypically recommended for BOW ('bag of words') or n-gram approaches, and thereported accuracy is outstanding. Additionally, this paper explores thepotential for novelty (forgery) detection, or 'one-class classification'. Ananalysis of the disputed Aldine Additamentum (Sil. Ital. Puni. 8:144-225)concludes (p=0.0013) that the metrical style differs significantly from that ofthe rest of the poem.
Quick Read (beta)
Metre as a stylometric feature in Latin hexameter poetry
This paper demonstrates that metre is a privileged indicator of authorial style in classical Latin hexameter poetry. Using only metrical features, pairwise classification experiments are performed between 5 first-century authors (10 comparisons) using four different machine-learning models. The results showed a two-label classification accuracy of at least 95% with samples as small as ten lines and no greater than eighty lines (up to around 500 words). These sample sizes are an order of magnitude smaller than those typically recommended for BOW (‘bag of words’) or -gram approaches, and the reported accuracy is outstanding. Additionally, this paper explores the potential for novelty (forgery) detection, or ‘one-class classification’. An analysis of the disputed Aldine Additamentum (Sil. Ital. Puni. 8:144-225) concludes (=0.0013) that the metrical style differs significantly from that of the rest of the poem.
Keywords: Latin; digital humanities; machine learning; poetry; stylometry; authorship attribution
While authorship attribution studies, and stylometry more generally, are becoming much more common, the bulk of the research has been applied to prose. In terms of work that considers poetry qua poetry, the pickings are rather slim. \citeAkao_computational_2012 attempt to computationally assess aesthetics. \citeAomer_arud_2017 apply the Arabic science of poetic metre (Arud) to authorship attribution, but the texts they analyse are all prose. Historically, some significant work has been done on Shakespeare but, for example, the recent computational results of \citeAilsemann_christopher_2018 have been sharply criticised by \citeAbarber_marlowe_2019 as a misapplication of Burrows’ Delta [burrows_delta:_2002]. \shortciteAtizhoosh_poetic_2008 and \shortciteAchaudhuri_small_nodate both set about distinguishing poetry from prose, but offer no analysis of the poetry itself. One notable exception is \shortciteAneidorf_large-scale_2019, which sets out to demonstrate the single-authorship of Beowulf using a range of techniques, including a consideration of metre, albeit brief. This general lacuna has been noted by \shortciteAplechac_versification_2019, who have begun to treat metrical features as a first-class citizen of the stylometry universe, and are some of the few researchers applying the most recent multivariate and machine-learning techniques. One final paper that deserves attention is \shortciteAforstall_evidence_2011, which examines metre, specifically in Latin poetry. Unfortunately, the methods used by this team treated syllable quantities in Latin simplistically as an -gram (a string of symbols, where each symbol may only be \metricsymbolsu or \metricsymbols_), and they were unable to achieve useful separation between authors on this basis. One reason that poetry-specific approaches are important is that the best-known attribution methods for prose,11 1 A good survey is available in \citeAjockers_comparative_2010. The present consensus seems to favour analysis based on frequency of closed-class words (eg function words) or character -grams. However Bag of Words (BOW) approaches are still popular, in particular as implemented in the R stylo rolling_delta() method \shortciter_stylo. as aptly pointed out by \citeAeder_does_2015, require fairly large sample sizes, which are often not available for verse.22 2 \citeAeder_does_2015 suggests a 5000 word minimum for authorship studies on prose. Later eder_short_2017, 4 he revises this to “as little as 2000 words in many cases”, which is still a great deal too many to be viable for many questions concerning poetry. Although it does not rhyme, Latin hexameter offers a particularly rich interplay of metrical features, and it was hypothesised that the density of stylistic information contained in the poems’ metre would allow for effective analysis with much less text.
2 Research Questions
I address two research questions in relation to the analysis of Latin hexameter poetry. The first, and most fundamental is this: “Are the metrical attributes of Latin hexameter poetry an effective feature for stylometric analysis?”. I demonstrate, via two-label classification, that the answer is emphatically yes. Having validated the approach, I apply metrical analysis to the disputed authorship of the Aldine additamentum (Sil. Ital. Puni. 8:144-225), seeking to re-address the question: “Is this passage genuine?”.
The website Pedecerto \shortcitecolombi_pedecerto_2007 has, for some time, offered on-demand, and highly accurate, scansion, particularly optimised for hexameters and elegaic couplets. In partnership with the site Musisque Deoque [mqdq_2007], they also maintain an extensive digital library of Latin poetry. This scansion is presented via their webpage as an image, showing the syllable quantities and other metrical information (caesurae, elision, hiatus, diaresis etc). In March, 2019, however, in response to my enquiry, their technical team added a new feature which allowed the download of any of the MQDQ poems in XML format, including the full scansion.33 3 http://www.pedecerto.eu/pagine/autori, Retrieved December 3, 2019. This offers a valuable resource to Digital Humanities practitioners, and made much of this present work possible. In Fig. 1, we can see the wealth of information available for each hexameter line. As well as the pattern of dactyls and spondees in the first four feet (DDDS) we can see the caesurae (CM or CF for strong and weak, respectively) and, most importantly, the full scansion of every syllable. Each syllable in the line is marked by two symbols, showing the foot in which it falls and a letter representing the position in that foot—so, for example, 1A1b1c corresponding to vitaque describes a three syllable word, with the arsis (initial syllable) of the first foot followed by two breves (short syllables).
3.1 Feature Selection
There are four general types of metrical features that were extracted from each line of hexameter (a concise list is available in the Appendix, Table 4). The first, which has been most often studied, is the metrical pattern in the first four feet. A hexameter line is constructed from six feet, each of which can be either a spondee (\metricsymbols__) or a dactyl (\metricsymbols_u u). However by convention, the final two feet are almost always dactyl, spondee (\metricsymbols_u u , __).44 4 A spondee may appear in the fifth foot, but these are very rare. There are twenty-three such lines in the Aeneid of Vergil, comprising around 0.2%. This yields sixteen possible foot combinations. These combinations have been extensively studied by Classicists, the ‘recent’ standard works being \citeAplatnauer_1951 and a string of publications by Duckworth in the 1960s.55 5 cf, at the least, Duckworth \citeyearNPduckworth_horaces_1965, \citeyearNPduckworth_five_1967, \citeyearNPduckworth_maphaeus_1969 \citeyearNPduckworth_vergil_1969. There are probably others. The next group of features are the caesurae. A caesura occurs whenever there is a word break in the middle of a foot. Caesurae can, thus, occur after the initial spondee, which I will refer to as a strong caesura or after the first breve in a dactyl, a weak caesura.66 6 An interested reader will find a range of other names in the literature: from the distasteful ‘masculine’ vs ‘feminine’, to several delightfully obscure technical terms, derived from the Greek, that encode both the strength and the position—pentethemimeral, hepthemimeral etc. By convention, although any foot may (technically) contain a caesura, attention is restricted to the ones in the second, third and fourth feet. I should note that, in traditional analysis, a line of hexameter is considered to have a principal caesura, which entails a pause; often a sense-pause, although sometimes simply a pause for breath. The present analysis makes no attempt to determine which, if any, of the available caesurae are ’principal’. It is important to understand, however, that the general ‘rule’ was to place a strong caesura in the third foot, although every author deviated from this rule to a certain extent as a matter of stylistic preference.
The third class of features requires a little explanation. The first syllable of each of the six feet is called an ictus syllable. This term, although Latin (lit. stroke, thrust, blow) derives from ancient Greek hexameter. Due to the language difference, however, it was not the ictus syllables in Latin verse that carried the primary stress—instead the Latin words were stressed (or accented) as usual. This interplay between Latin word accent and metrical ictus creates an inherent conflict, which formed an important part of the style of Latin hexameter. Perhaps counter-intuitively, the general trend was to create conflict throughout the first four feet (otherwise, presumably, the line sounded too ‘sing-songy’), and in almost all cases the conflict resolves in the two final feet, where the ictus and the accent correspond. Once again, this has been well-studied in the traditional literature: consult in particular \citeAknight_homodyne_1931 and \citeA[17-24]duckworth_vergil_1969. In the following discussion I adopt the terminology of these studies, and refer to a foot in which the ictus and accent coincide as homodyne.77 7 Knight and Duckworth both focus exclusively on conflict in the fourth foot. As will be seen later, conflict preferences in any foot are important stylistic markers. Based on this analysis, conflict/harmony in the first foot (not the fourth) is actually the best place to look to distinguish different authors (see Table 1). Finally, I measured elision. When Latin words ending in vowels or nasals precede words that begin with a vowel, an elision occurs, and the final syllable of the first word is not counted for metrical purposes. Opinions differ as to whether elided syllables are completely dropped when the poem is read aloud, whether they are slurred or perhaps lightly pronounced—their pronunciation does not concern us here, only their presence. I measured the total number of elisions for each line (not including prodelision, a slightly different feature)—the only non-binary feature.
While the metrical patterns and caesurae are trivial to extract from the MQDQ XML data, determining the ictus/accent conflicts required considerably more work. The general rule for word-accent in Latin is very simple, but there are a surprising number of exceptions and edge cases. In the end, it was necessary to develop new code to perform this analysis, which is incorporated into the open-source python package MQDQParser [nagy_mqdq_2019]. Whenever new analysis tools are developed, care must be taken to ensure that the results are accurate—it is useless to base statistical analysis on bad data. There are at least two points of comparison. The first is Knight’s ‘Homodyne in the fourth foot of the Vergilian Hexameter’. Knight informs us that “[f]ourth-foot homodyne is by comparison rare in Vergil, but not very rare. The percentage of it to the total number of lines in the Aeneid is 35.95 per cent” [knight_homodyne_1931, 186]. Using my algorithm, fourth-foot homodyne was detected in 3507 lines (of 9840 in my edition), which is 35.65%. The difference in our percentages represents perhaps 30 lines on which we disagree. Knight also lists some percentages by individual books. For Aen. 1, he has 28.61% while I have 28.82%; Aen. 8, 39.97% to my 39.29%; Aen. 10, 32.59% vs 32.71%. While Knight does not share with us his methodology for scanning and tabulating the entire Aeneid in the 1930s (perhaps it was a long winter), he does mention that he performed “two computations, in which different texts were used and different conventions followed” and that his figures varied by only 0.45% [knight_homodyne_1931, 186 n. 1]. The second source for independently determined statistics of this kind is \citeA[19-20, plus final Table]duckworth_vergil_1969. Duckworth consistently finds texts to have a slightly higher homodyne percentage than does Knight. Thus, for the entire Aeneid, Duckworth records 37.78% fourth-foot homodyne. This discrepancy is essentially due to disagreement among scholars regarding the correct accent of a few two syllable words (ergo, illuc, …), and whether certain conjunctions (et, at, aut, sed, …) bear any accent at all. Based on my research, I have accepted the views of \citeA[88-9]allen_vox_1965 (which apparently accord closely with Knight’s), but this would be a poor venue in which to set out the entire debate.88 8 For those that care to go beyond Allen, the best collection of the primary sources with respect to accent is \citeAschoell_accentu_1876, although the truly dedicated may prefer to read the works unabridged in \citeAkeil_heinrich_grammatici_1857. The sources are, frankly, a mess of contradictions, and many of them are \nth5 century or later, which stretches the appellation of ‘primary’. In any event, it can be hoped that as long as the analysis is being applied consistently to all texts that the statistical effect of any systemic errors will be negligible.
3.2 Two-Label Classifiers
Before attempting to use metrical features for any sort of authorship attribution, it should first be established that these features are able to distinguish authors at all. It would be foolish to rely on a measure that cannot do what an expert reader can do by instinct—to tell the difference between the hexameters of, say, Vergil and those of Ovid. To this end, I collected and analysed Vergil’s Aeneid; Ovid, Metamorphoses; Statius, Thebaid; Lucan, Pharsalia and Silius’ Punica. These works are all composed in dactylic hexameters, and written as ‘epics’. Each pair was then analysed as a two-label classification problem with four algorithms: Extremely Random Trees, Gaussian Naïve Bayes, Logistic Regression and Support Vector Machines. All tests were carried out using the Python package scikit-learn [scikit-learn], and replication code is available in the github repository for this paper [nagy_hexml_2019].99 9 The accompanying repository [nagy_hexml_2019] also includes replication code for all Figures and Tables that appear in this paper. The tests were conducted with an 80/20 train-test split, with a chunk-size of 81 lines (to model the later authorship problem). In every case except Vergil vs Silius and Vergil vs Statius the accuracies were virtually 100%. Because the most ‘difficult’ classification is Silius vs Vergil, the rest of this section is mostly concerned with that pair. In Fig. 2, we can see that analsying foot patterns (Feet Only) is only slightly more effective than considering nothing but the patterns of ictus/accent conflict (Conflict Only)—this underscores the value of conflict as an indicator of style. In fact, in terms of foot patterns, the importance of the first and fourth feet (dactyl or spondee) far outweighs the other two. It can be seen from Fig. 2 that the set Caes+Confl+FirstFoot (Caesurae, Conflict and First Foot) performs almost as well as the entire feature set.
Another benefit of working with pairwise classification is that it can provide some kind of intuition as to which metrical features are the most useful to consider when distinguishing between authors. Not all machine learning algorithms can produce understandable feature importances, but it is possible to extract them from the Random Forest family of algorithms (this study used ExtraTrees from scikit-learn) and Support Vector Machines (with a linear kernel). I compared each pairwise combination of the five works above (10 total comparisons) and averaged the feature importances according to SVM and ExtraTrees, with the results shown in Table 1. It is important to note that the two sets of values listed cannot be compared with each other, and it is not clear how the weights compare within a set (i.e. a feature with a weight of ten may not be ten times as important as one with a weight of one). In terms of raw ranking, though, they provide an interesting guide.
After each line is converted to a feature vector, it can be considered as a single observation. However, because of the inherent variability of the lines, the two-label classifiers were all found to perform poorly on the raw data, with accuracies under 60% (not much better than chance). This seems to be intuitively reasonable—a human reader would also find it more difficult to determine the author of a single line than to examine a hundred lines at once. The feature observations were, therefore, ‘chunked’, by taking a set of lines and considering the set to be a single observation with the mean of the feature values; a set of twenty lines of which 15 had a strong third-foot caesura would have an F3SC value of 0.75. The trade-off, of course, is that the number of observations is reduced: 10,000 lines of the Aeneid with a chunk size of 20 becomes just 500 observations. The question then becomes ‘how many lines do we need in a chunk before we can make reliable decisions?’. The answer, of course, is ‘it depends’. Comparing Silius to Ovid, a 10-line chunk is enough to yield more than 90% accuracy (see Fig. 3). Silius and Vergil are the most similar,1010 10 Silius, it seems, admired the work of Vergil with almost religious fervour, cf Plin. Ep. 3.7, 8. so, considering the performance of four different classification algorithms on this pair (Fig. 4), it seems reasonable to expect that anything over 60 lines should be enough to yield sensible results in general. It should also be noted that the order of the lines in the original works were randomised before being chunked. The intention of the randomisation process was to normalise ‘non-atmospheric’ variation. Latin poets use the metre of their verses for poetic effect, and so Vergil will use different patterns in a battle scene than he does when describing funeral games—and yet (by hypothesis) his style is always ‘Vergilian’. By mixing the battles with the games, the love scenes with the death scenes, these surface variations are evened out, making it easier to see the deeper authorial style.
When considering the problem of reduced training sets, the low dimensionality of our feature set works to our advantage. Instead of considering hundreds of words or character -grams, we have just 16 metrical features. When the Aldine Additamentum is taken as a single observation, and a chunk size of 81 lines is used for Silius’ Punica (the same length as the Additamentum) we have 150 observations—not a great number. For algorithms that are sensitive to dimensionality it would be better to have more than 256 (16), but the dimensionality does not seem unreasonable. If a smaller set of features is required, experiments indicate that standard feature selection techniques appear to work extremely well, with no loss of classification accuracy.1111 11 The downside, of course, is that the model will be less generally applicable. In Fig. 5, the best features were taken from the ordered list in Table 1 (as per SVM) and the Vergil vs Silius classification experiment was run with only those features. Of the global best features, the first eight perform as well or better as all 16. If the features are selected only with regard to Silius and Vergil, the accuracy is even better with six features than 16 (Fig. 2). This approach is not appropriate for problems where one author is completely unknown, but might be useful for a situation where there are a small number of candidate authors. Another possible approach to offset small training sizes due to chunking is to use repeated random sampling from the source lines. This is the approach taken in the following section.
3.4 Detecting ‘Scribal Interpolation’ in Larger Works
Having established that metrical features seem to be reliable indicators of authorial style, it now seems reasonable to apply them to an authorship problem. As mentioned, an interesting question is the authorship of the Aldine Additamentum.1212 12 For an excellent summary of background to this issue I refer the reader to \citeA[19-25]lee_silius_2017, whose thesis also includes a valiant attempt at univariate metrical analysis (26-8; Appendices 2-3, pp. 145-6), as well as a survey of the existing opinions in secondary literature (Appendix 1, p. 144). At just over 500 words, the disputed text is too short to be a useful candidate for BOW or function-word approaches1313 13 As mentioned (above, n. 2), this question of “how much text is enough?” has been explored effectively by Eder (\citeyearNPeder_does_2015 and \citeyearNPeder_short_2017). but, at 81 lines, it fits comfortably in the range where all of the two-author classification experiments achieved over 95% accuracy. Broadly speaking, this problem fits best under the heading of ‘novelty detection’. There are a variety of appropriate algorithms that we could have selected, including OneClassSVM or IsolationForest but the simplest and most explanatory seemed to be a multi-dimensional cluster distance. The general approach, therefore, is this: we arrange the samples in a 16-dimensional feature space, choose a suitable distance metric and assume some kind of Gaussian distribution. Then, by calculating the distance of each point from the central tendency, we can assume the distances to be distributed according to , and hence calculate a -value. Because of the nature of the chunking, the features are already scaled in the range [0,1] (they are the mean of binary indicators), however as can be seen from Table 2, there are some problems with co-variance and correlation.
Accordingly, the most sensible distance was seen to be the Mahalanobis distance, which ‘normalises’ the features by ’dividing’ by the co-variance matrix. In mathematical terms, the Mahalanobis distance of an observation from the sample mean is defined to be (where is the covariance matrix of the target distribution X). In the following discussion, we will mainly see , the square of the Mahalanobis distance, because it can be proven that follows the distribution, allowing for the direct calculation of a -value. For this experiment, the target distribution was created by repeated random sampling.1414 14 An astute reader may wonder why, if repeated random sampling is a reasonable approach, it was not used during our classification experiments to offset the loss of sample size caused by line chunking. The problem is that if we had trained on a repeated random sample and then performed classification on ‘real’ (sequential) chunks, much of the training data would re-appear (although in random places) in the test data. This would artificially inflate our accuracy and inevitably lead to over-fitting. The lines of the Additamentum were removed from the corpus, and then 10,000 sets of 81 lines were randomly selected with replacement. Based on experiment, this sample is large enough that there was negligible variation in due to the random process. The distance of the Additamentum from the target, 36.82, yields a corresponding -value of 0.0013, low enough to be statistically significant. These results can be fully reproduced with the code in the accompanying github repository [nagy_hexml_2019]. In an attempt to assess the reasonability of the final result, I made two other comparisons. When the Additamentum was compared to Vergil’s Aeneid, the corresponding -value was 0.0006. Next, I compared the mean vector (or centroid), representing an ‘average’ chunk of Vergil, to Silius, and found a much lower distance of 15.88 with a -value of 0.39 (recall, though, that we can tell Vergil from Silius with more than 95% accuracy). In other words, the metrical style of the Additamentum differs much more from either Vergil or Silius than they differ from each other. These results are summarised in Table 3. On face value, these results support the theory that the Aldine Additamentum was not written by Silius—with the most likely alternative being that it was introduced by a humanist scholar in the late \nth15 or early \nth16 century to resolve a lengthy manuscript lacuna.1515 15 c.f Lee, (above, n. 12)
An additional advantage of the Mahalanobis distance1616 16 This may be a novel observation; certainly I have not come across it elsewhere in the literature. is that the distance can be easily decomposed to show a per-feature contribution to the total distance.1717 17 The core of the Mahalanobis distance is , and it is easy to see that this reduces to a vector dot product (). All that needs to be done is to multiply point-wise and record the product vector. That vector is the feature contribution vector, and the sum of its entries is the squared Mahalanobis distance . This feature contribution vector seems to have good explanatory power, which can be extremely helpful in verifying results. For example, suppose that the contribution vector for a passage with a high distance indicates an unusual concentration of dactylic first feet. A poetic analysis might be able explain that divergence on stylistic grounds, considering the content of the passage. This kind of explanatory feature increases the transparency of computational methods. The relevant feature contribution vectors for this section are shown in Table 3.
3.5 Interrogating the Authorship Results
While these results are certainly very suggestive, it should be noted that they are not conclusive. Metre is only one aspect of poetic style, and it is certainly true that metre was consciously used by classical poets to impart an additional dimension to the verse—it is not an unbiased indicator. A worthwhile question to ask is whether some genuine passages might be this far from the ‘typical’ style. As with any statistical determination, when considering enough samples this is certainly possible and, indeed, even likely. To illustrate this, I did the following: I first removed the Additamentum from the text of the Punica, and then took a rolling window of 81-line chunks throughout the text, advancing each time by 27 lines (so that the chunks overlap). At each step, the distance was calculated in the same way as for the Additamentum—removing that chunk from the rest of the poem, and then taking the distance based on a target distribution of 10,000 random 81-line samples. In plain terms, I tried to determine how many continuous sections of the undisputed text were at least as unusual as the Additamentum. These results are shown in Fig. 6. There were six chunks which were at least as unusual, or about 1.3%. On examining them individually (albeit briefly), there seem to be plausible poetic reasons for the metrical distinctiveness of these chunks.1818 18 To explain this in full would require a lengthy discursion. However, as a brief example, the most extreme outlier, Puni. 8.555–636, contains about double the average number of proper nouns, which require some metrical gymnastics to accommodate. Disregarding those lines brings the fragment back into the ‘fairly normal’ zone. In addition, that section (surprisingly!) contains a number of short sections of deliberate rhyme which, once again, distort the statistics. Nevertheless, the results are enough to mandate caution. Although this evidence certainly supports the theory that the Additamentum is non-genuine, more work will be required to make the analysis conclusive. In particular, it seems sensible to attempt further tests using orthogonal feature sets, such as character -grams, function words, rare lexicon or other approaches that have been similarly well-established in attribution studies.
The clearest conclusion from this research is that metrical features are an extremely useful classifier for classical Latin hexameter poetry, and there seems little reason to doubt that they would be also effective for elegiac couplets. I note that this result is contra \citeAforstall_evidence_2011, and must conclude that the difference lies in both the additional sophistication of the feature extraction (this study extracted more metrical features) and in the way the features were treated (it seems that -gram frequencies on syllable quantity do not capture enough of the ambient stylistic information). In terms of further extensions, I am very optimistic about the prospects for the less common Latin metres, and would be reasonably surprised if the techniques were not also applicable to classical Greek. While single-line observations do not seem to be useful, chunked observations can return good results with chunks as small as ten lines in cases where styles are very different (Fig. 3). Metrical features have low dimensionality, which may be useful in cases where limited training material is available. For Latin, a subset of eight features yielded very similar accuracy to all 16 features when used for classification. When designing experiments with metrical features, practitioners should bear in mind that some features are strongly correlated (Table 2). In the classification tests, this did not seem to impede high accuracy.
In the authorship attribution test, the chosen metric was the Mahalanobis distance, which is designed to correct for the issues of correlation and co-variance. As was shown, the Mahalanobis distance has two other desirable features. First, it can be used directly to calculate a -value, which provides a well understood difference indicator. Second, during the calculation of the Mahalanobis distance, it is possible to extract a feature contribution vector, which seems to have useful explanatory properties (Table 3)—this allows us to ‘bridge the gap’ between opaque computational methods and traditional philology. To the best of my knowledge, this feature contribution vector has not been discussed in the stylometry literature. Based on this technique I analysed the disputed Aldine Additamentum in the Punica by Silius Italicus. Here there were some important differences in methodology; the most noteworthy is that a target distribution was created through random sampling with replacement. These large sample distributions provided distance measurements that minimised variation due the random process. The results appear to support those scholars who claim that the work is not genuine. With a -value of 0.0013, the Additamentum differs, metrically, from the style of the rest of the poem in a statistically significant way. For comparison, I examined the rest of the poem using a rolling window and found only six passages (of 446) with higher distances.1919 19 See Appendix, Table 5 for a more detailed analysis of these passages. Although this authorship result is certainly promising, more research should be conducted using orthogonal methodologies before it could be considered to be a substantial claim.