Used the internet. [84] The Prime survey was conducted online and in English only with a total sample of 2521 potential respondents selected from Nielsen’s online panel. The total responses received for this Prime survey was 888. It cannot be overemphasized that unlike the NMI Survey, the Prime Survey was not a national readership survey of the random population in Peninsular Malaysia. Instead, the Prime Survey was based on a selected sub-population of online respondents selected from Nielsen’s online panel. Comparison of NMI Survey to Prime Survey [85] Sun Media contended that the market share of theSun is appreciably higher than the one surveyed under the NMI Survey and as such the NMI Survey must be unreliable and indeed false and wrong. [86] The table on comparative readership between the NMI Survey and Prime Survey is as set out in para 10B.5 of the Amended Statement of Claim (“ASOC”) is set out below: 39 [87] Taking the readership figure from the 2 Surveys and dividing that with the circulation figure from the Audit Bureau of Circulation (“ABC”), one would get a readership per copy or RPC score of 0.9 under the NMI Survey for 2008. It is admitted that this has been derived from an additional information from another source i.e. the ABC figures which Nielsen does not include in its Data. The RPC of theSun then is a conclusion that is arrived at outside of the available Data that is extractable by a subscriber. This is called “Inferred RPC” as submitted by learned counsel for SunMedia. 40 [88] The ABC is an independent non-profit bureau with a membership that consists of various members from the media industry such as representatives from newspaper publishers (including theSun, NST and The Star), the Malaysian Advertisers Association, the Association of Accredited Advertising Agents Malaysia and the Media Specialists Association of Selangor and Wilayah Persekutuan. [89] I accept that the role of the ABC is to report the audited circulation data of newspapers and magazines of its members for the benefit of the Marketing Communications Industry of Malaysia. [90] There was a question introduced by Sun Media into the Prime Survey in helping Sun Media understand the perception of a respondent as to how many persons read the respondent’s copy of a daily (English) newspaper. The question was as follows: “Approximately how many other people read YOUR copy of the DAILY NEWSPAPER which you read?” [91] This is called the perceived pass-on rate and from that figure one then proceeds in the same manner to calculate the “Perceived RPC” of 2.9 from the Prime Survey 2008. The RPC number is a useful estimate of the popularity, or reach, of a particular newspaper. 41 [92] The readership figures of theSun published by Nielsen, in the period between 2006 and 2010, are set out in paragraphs 11A to 11D of the ASOC (the “NMI Figures”). As explained by Nielsen, “Readership” is not synonymous with “Circulation”. They are different concepts and distinct measurements. They are not comparable especially in the case of theSun being a free newspaper. “Readership” looks at the number of people who claim to have read the newspaper yesterday. [93] There are clearly material differences between the Prime Survey 2008 and the NMI annual survey such that it would not be reasonable to compare one to the other with respect to yielding the same results where readership is concerned. There are differences in the Population Profile, Size and Projection to the national population. Here are some of the differences between NMI and Prime such that a comparison with the conclusion that NMI is wrong and would not be logical nor reasonable. [94] First, NMI is a syndicated survey nationwide whereas Prime is customized and focused on the KL/PJ area. NMI does not target the readership of theSun or any other media or publications. The NMI Survey covers more than 30 different types of media, product and services and 42 readership of newspapers and magazines is only but one part of the entire Survey. [95] As explained by Mr. Richard Hall, Nielsen’s Managing Director, in his evidence (See Examination-in-chief of Mr. Richard Hall DW1-WS Q&A 32): “I say so because the NMI is a national survey, which methodology is not skewed in favour of any one particular client or product, and which is not intended to provide a deep analysis of any particular product or market segment. The targeting of a specified market or product would be done through customized research such as the Prime survey and not a syndicated survey of national level readership (and other consumption) like the NMI. A feature of a national level readership and consumption survey is that the same research methodology and sample design is used across the board for all the titles (and other products and services) that form part of the survey, and that the survey occurs on an ongoing basis. This ensures that the consumption of all products within the survey is measured against the same parameters and that they are data trends.” (emphasis added) 43 [96] In NMI there is a stratified random sampling whereas in Prime it is preselected from a sub-population of the Defendant’s online profile; more of a dipstick survey for a more particular point in time rather a survey throughout the 4 quarters of a year. [97] Profile is also different of their population surveyed in that for NMI it is consisting of citizens only, 15 years old and above, face-to-face interview, against all income levels and the closest to Prime Survey where income is concerned is the RM3,000 per month salary. [98] The Profile in the Prime Survey included non-citizens like expatriates, hotel guests and would cover foreign workers as well; all earning RM2,500.00 and above per month, 20 years old and above, white collar workers who are CEOs, directors, professionals, executives, managers, businessmen (“PEMBs”), internet users and English speaking. [99] Sample size wise that of NMI is 10,000 whereas that of Prime is about 888 that responded. [100] NMI is projected to the whole population of Peninsular Malaysia based on age, gender, race and region where weighting is concerned whereas for the Prime Survey the sample is projected to a universe of 403,000, which is Nielsen’s estimate of the population of Top Management 44 and Affluent Consumers in the KL/PJ area. As there were no available Government statistics for this target group, the universe estimate was obtained by using the 2003 Nielsen’s Asian Target Market Survey (“ATMS”) base. ATMS is a survey across 7 Asian cities, namely Hong Kong, Singapore, Kuala Lumpur, Taipei, Manila, Bangkok and Jakarta using both telephone as well as face-to-face interview. [101] As explained by DW3 Miss Andrea Douglas who was the Executive Director who did Market Research in Nielsen Malaysia in 2007 when the Prime Survey was commissioned: “The weighting and projection of the Prime results was also different from the NMI. The Prime sample was rim weighted and projected to the estimated population of top management and affluent consumers (as defined in the Prime survey proposal at p. 4004 of the Common Bundle of Documents (“CBD”) 5(8)) living in Kuala Lumpur/Petaling Jaya whereas the NMI sample was cell weighted and projected to the general population of Peninsular Malaysia aged 15 and above.” [102] The Plaintiff has no problem accepting the results of the NMI Survey that are in its favour in its presentation in 2007 to its stakeholders. Some of these results are for instance steady growth of readership in the KL/PJ 45 area, higher income profile, urban concentration, university education, decision makers and laptop owners. [103] I think one cannot cherry pick the favourable from the less favourable for the conclusions are drawn from the same common pool of Data that are extracted from NMI by use of the software given to subscribers which allows for various permutations to be generated based on the parameters that one may input. The brunt of Sun Media’s complaint [104] Perhaps the sore point in Sun Media’s complaint is that if one were to compare the Readership Per Copy (RPC) of theSun vis-a-vis that of the other 2 English dailies in the Star and the NST, one sees that the RPC is less than one. It goes without saying that when one is not comparing like to like with the same parameters then one should not be surprised that the results may differ though there are other findings that are the same and Sun Media is not complaining. Sun Media maintained that their suspicion of under-representation of its readership in the KL/PJ area among high income earners or RM3,000 per month salary and above has been proved right in the Prime Survey for the readership figure increases substantially and even surpasses that of NST. 46 [105] However Nielsen does not calculate or rely on the RPC where its results is concerned. It does not claim to and does not measure RPC for the newspapers. It makes no reference and does not take into consideration the circulation figures available from the ABC. It only measures readership by the number of readers as projected to the total population. [106] The RPC is derived from dividing the readership figure with the number copies in circulation. Here is where the difference and divergence lie in the audit method of paid newspapers compared to free newspapers. Whilst one can expect a paid readership to have at least one reader per newspaper subscribed, if not more as would be the likely if the newspaper is subscribed for office or home reading. It is a reasonable inference drawn from why people would pay for a newspaper if not for the purpose of reading, both in keeping abreast with the news and for general information and the sheer joy of reading things of interest. [107] However, the same cannot be said of a free newspaper. Unless all of it is handed out by a staff of the media company normally at strategic places where there is high human traffic like at commuter stations where waiting time for the commuter and commuting can be usefully occupied 47 flipping through the pages of the newspaper or even glancing at the caption to pictures therein and that would have been considered under the Survey method as having read, there is bound to be leakages and copies not picked up and read and picked up but for other purposes other than for reading. [108] The circulation figures are supplied by Audit Bureau of Circulation (“ABC”) and from the evidence, we see that there is very restricted audit where circulation is concerned for a free newspaper like theSun in this instance. As gathered from the evidence that emerged from the cross-examination of the Plaintiff’s witnesses, the ABC does not audit what is not picked up at the end of the day from the various pick-up points. What they audit, and even then confining only to copies made available for collection at the pick-up points were covering only hardly 1% or so of the total number of pick-up points. [109] Sun Media further relied on its own stock count report. That report also does not refer to copies left behind at the end of the day. There are times when copies are left untouched or taken for other purposes other than reading as testified by the Defendant’s witnesses. It would not be unfair to say that there are times when more than a copy is picked up 48 because it is relatively thinner when compared to the other 2 main English dailies. [110] Surely one can take cognizance of the fact that there is an industry of second-hand or recycled newspapers in Malaysia. It would be different if Sun Media actually engages workers to physically hand out all copies published every day. It can then be said that the RPC would be close to 1 on the assumption that the one who stretches out his hand to collect from the staff of Sun Media would read it for a minute or so at least based on the agreed definition of recently read copy. The word for it is “commuter newspaper” presumably read more by commuters when they are waiting for public transport and during their journey. [111] To have an RPC of less than 1, which information is not provided by Nielsen but rather derived from the circulation figures furnished by ABC, is not necessarily alarming or indicative of the fact that the NMI Survey results as complained by Sun Media is inaccurate. The fact of leakages is real as borne out by the stock count report and the propensity of human nature to take sometimes more than what is required for purposes other than for reading. 49 [112] The traditional model of paid subscription on the other hand is audited by the ABC based on receipts of payments and it is generally accepted that a house or office that subscribes it would have at least 1 person reading it with the likelihood that others at home or in the office would be reading it as well. [113] To say that the NMI Data complained of is inaccurate and an under-representation, one would have to believe that almost every copy that the Plaintiff publishes of theSun that is being distributed as being effectively picked up and read by at least one person. The Plaintiff has not shown any evidence that that is the case and it is merely speculation that every copy left at the pick-up points is being taken for the purpose of reading. [114] This is what Sun Media expects which is that the readership of theSun to be at least 1 in that every copy is being picked up for reading. That has not been borne out by the evidence. No doubt the Prime Survey serves a limited though useful purpose; to test whether one’s strategy in reaching out to one’s target audience has been successful and to see a discernible trend in the reading habits and preference of the High-income earners in the KL/PJ area. It was designed to provide a picture of the readership of the Sun vis-à-vis its major competitors by testing against a 50 pool, not necessarily representative, of readers in the KL/PJ area drawn from the respondents with the criteria specified. [115] To compare NMI Survey to Prime Survey where the ratio of readership and RPC are concerned would be to compare an apple to an orange. I agree with the Defendant’s learned counsel that they differ in many ways in terms of design and universe, survey methodology and objectives. They are not comparable and certainly would not be any indicator of the correctness or falsity of one or the other. [116] It must also be noted that because Prime Survey is a customized survey as opposed to a syndicated nationwide survey, it has in its questionnaires asked question online of its respondents with respect to perceived pass-on rates. The question of those who responded as having read theSun yesterday is the question of who they think would also have read the same copy of theSun newspaper. It is a pure guesstimate and not even an estimate at that. Surely guesstimate figures cannot be relied on too much as compared to the figures in the NMI Survey which does not take into account this perceived pass-on rate. [117] The Prime Survey is not a random survey and indeed all the complaints that Sun Media’s Expert Witness Mr Nimbalkar has on the NMI 51 for its so-called lack of randomness can most appropriately be leveled at the Prime Survey 2008. It is precisely what a survey is not, though it is good to test one’s theory or hunch with respect to what one has in mind on effectiveness of one’s targeting strategy. [118] There is the related complaint that the middle to upper income segment of the population has not been sufficiently surveyed such that when projected to the population in Peninsular the end result is skewed against these target audience of Sun Media. This group do people have come to be referred to in literature as the PMEBs (Professionals, Managers, Executives and Businessmen). However the NMI as a national survey measures readership across all income levels and it does not discriminate the respondents by profession or designation. As stated, the only qualifying criteria is that a Respondent is 15 years and is a Malaysian citizen. [119] As pointed out by Nielsen, there is no official statistics or government records of any defined “middle to upper income Group” or “PMEBs” which would be necessary as a benchmark for measurement. About the only one page document produced by the Plaintiff and not a complete one at that during Submission is the income level of this category of people closest to 52 the PMEBs but then their criteria for monthly income includes more than just their salaries and includes the value of rent for their homes as well. It certainly cannot be relied on for comparison purpose. [120] Nielsen does recognize that there would always be the “harder to reach” respondents given their social economic status (“SES”) or demographics. That is a perennial problem for all Survey work undertaken at a national level for all income groups and across different dwellings and here the problem arises from the strict protocols where security is concerned for those who stay in condominiums and gated and guarded communities. [121] Mr Nimbalkar, Sun Media’s Expert, took umbrage with Nielsen’s Survey Methodology and Design here as he concluded that there was an over sampling of the lower income group and retirees and an under sampling of the higher income group and the PEMBs. Nielsen acknowledged these challenges in a national survey compounded further by the fact that listing in the White Pages phone directory has dropped by more than 50% in 2007 and if I may say, with greater concerns now for issues of privacy and contact numbers and even emails. 53 [122] No viable alternative methods have been proffered by Mr Nimbalkar and even if some hybrid method of pure internet Survey is conducted, again one cannot run away from the fact that it may then well lack the element of randomness as those who would to respond are already drawn from a pool of those internet users who consents to be interviewed. As I said before no method is perfect and free from deficiencies and like all survey results, one would have to interpret it with some measure of discernment and discretion. [123] Mr Nimbalkar then said that a pure online Survey is acceptable though it might lack the randomness that he complained of with respect to the use of the PSUs. At paragraph 12.18 of Mr Nimbalkar’s third expert report (P-RER 2), he reproduced relevant excerpts from an article titled “Report of the AAPOR Task Force on Non-Probability Sampling” released in June 2013. The article acknowledged that “Sampling methods used with opt-in panels have evolved significantly over time, and, as a result, research aimed at evaluating the validity of survey estimates from these sample sources should focus on sampling methods rather than the panel themselves”. 54 [124] Mr Nimbalkar noted that “On page 13 of the AAPOR report, the task force has noted quite a few instances of use of non-probability sampling (panel) that have yielded results that are as good or better than probability based surveys when measured against an external criterion”. [125] Mr Nimbalkar was thus emboldened to conclude that “In summary, the AAPOR report says that due to difficulties faced (entry barrier, refusals etc.), costs and time, pure probability sampling is becoming more and more difficult. As a result, panels have become very popular. A panel study could be used for population inferences provided it is corrected for biases either prior to the survey (e.g.by using quotas) or after the survey (e.g.by using weighting)”. [126] I must say that in countries like Hong Kong and New Zealand where internet penetration is high and where privacy issues are of prime consideration, an online interview might be the next best alternative though there would still be the problem of insufficient randomness and with that the problem of how representative it would be with the perennial problem of biases that have to be addressed from a pre-selected list of internet addresses. There is also no known directory of internet users and where one breaks down in dwelling units and location, as well as ethnicity and 55 income groupings, there will be many other media owners that would have a bone to pick with Nielsen! [127] Mr Andrew Whitney, DW5, Nielsen’s regional measurement science leader for Media, confirmed that internet survey has been used by Nielsen in Hong Kong for about 10 years already and that Nielsen will be doing that in 2017. However he was quite satisfied that the booster method has tackled this problem of sedimentation and that the problem is offset or adjusted by the booster. For the period 2006 to 2010 Mr Whitney had overall responsibility for the sample design and weighting strategy applied to both the NMI survey and Prime Survey. [128] I am satisfied that this challenge has been sufficiently addressed with the use of booster samples to be achieved on a quarterly basis (See CBD 5(1) at page 839) as follows: Main sample – 2200 Male booster – 75 Upper SES booster – 125 Location booster – 100 Total sample – 2500 quarterly (10,000 yearly) 56 The Main sample is split 65% urban and 35% rural. All booster samples are from urban areas with higher SES and are set with target achievements of this by location/ market centers and dwelling types such as bungalow/ SemiD, Condominium/ luxury apartments. [129] Miss Wong Mae Suen DW2 in Q&A 20-21 of her Witness Statement has explained the booster sample as follows: