Business intelligence evaluation model in enterprise systems using fuzzy PROMETHEE


  • Mansoureh Maadi
  • Mohammad Javidnia
  • Malihe Khatami



Business intelligence, enterprise systems, Fuzzy PROMETHEE, fuzzy theory, PROMETHEE


In this paper, a new model to evaluate business intelligence (BI) for enterprisesystems is presented. Evaluation of BI before making decisions about buying and deploymentcan be an important decision support system for managers in organizations. In this paper, asimple and practical method is presented that evaluates BI for enterprise systems. In this way,after reviewing different papers in the literature, 34 criteria for BI specifications aredetermined, and then by applying fuzzy PROMETHEE, different enterprise systems areranked. To continue to assess the proposed model and as a case study, five enterprise systemswere selected and ranked using the proposed model. The advantages of PROMETHEE overother multi-criteria decision making methods and the use of fuzzy theory to deal withuncertainty in decision making is assessed and it is found that the proposed model can be auseful and applied method to help managers make decisions in organizations.


Abzaltynova, Z. & Williams, J. 2013.

Developments In Business Intelligence

Software, Journal of Intelligence Studies in

Business 3(2). pp. 40-54.

Adamala, S. & Cidrin, L. 2011, Key Success

Factors in Business Intelligence, Journal of

Intelligence Studies in Business, 1, pp.107-

Alter, S. 2004. Work system view of DSS in its

fourth decade. Decision Support Systems, 38,


Al-Shemmeri, T., Al-Kloub & B. Pearman, A.

Model choice in multicriteria decision

aid. European Journal of Operational

Research, 97, pp. 550–560.

Anderson, J. L., Jolly, L. D. & Fairhurst, A. E.

Customer relationship management in

retailing: A content analysis of retail trade

journals. Journal of Retailing and Consumer

Services, 14, pp. 394–399.

Azadivar, F., Truong, T. & Jiao, Y. 2009. A

decision support system for fisheries

management using operations research and

systems science approach. Expert Systems

with Applications, 36, pp. 2971–2978.

Baars, H., & Kemper, H. 2008. Management

support with structured and unstructured

data-An integrated business intelligence

framework. Information Systems

Management, 25, pp. 132–148.

Berzal, F., Cubero, J. & Jiménez, A. 2008. The

design and use of the TMiner componentbased

data mining framework. Expert

Systems with Applications.

Bolloju, N., Khalifa, M. & Turban, E. 2002.

Integrating knowledge management into

enterprise environments for the next

generation decision support. Decision Support

Systems, 33, pp. 163-176.

Bose, R. 2009. Advanced analytics: Opportunities

and challenges. Industrial Management &

Data Systems, 1092, pp. 155–172.

Brans, J. P., Mareschal, B. & Vincke, P. H. 1986.

How to select and how to rank projects: The

PROMETHEE method. European Journal of

Operational Research, 24, pp. 228-238.

Bui, T. & Lee, J. 1999. Agent-based framework

for building decision support systems.

Decision Support Systems, 25, pp. 225–237.

Cheng, H., Lu, Y. & Sheu, C. 2009. An ontologybased

business intelligence application in a

financial knowledge management system.

Expert Systems with Applications, 36, pp.


Courtney, J. F. 2001. Decision making and

knowledge management in inquiring

organizations: Toward a new decision-making

paradigm for DSS. Decision Support Systems,

, pp. 17–38.

Damart, S., Dias, L. & Mousseau, V. 2007.

Supporting groups in sorting decisions:

Methodology and use of a multi-criteria

aggregation/disaggregation DSS. Decision

Support Systems, 43, pp. 1464–1475.

Delorme, X., Gandibleux, X. & Rodrı´guez, J.

Stability evaluation of a railway

timetable at station level. European Journal of

Operational Research, 195, pp. 780–790.

Elbashir, M. Z., Collier, P. A. & Davern, M. J.

Measuring the effects of business

intelligence systems: The relationship

between business process and organizational

performance. International Journal of

Accounting Information Systems, 93, pp. 135–

Eom, S. 1999. Decision support systems research:

current state and trends. Industrial

Management & Data Systems, 995, pp. 213–

Evers, M. 2008. An analysis of the requirements

for DSS on integrated river basin

management. Management of Environmental

Quality: An International Journal, 191, pp.


Fazlollahi, B. & Vahidov, R. 2001. Extending the

effectiveness of simulation-based DSS

through genetic algorithms. Information &

Management, 39, pp. 53–65.

Feng, Y., Teng, T. & Tan, A. 2009. Modelling

situation awareness for context-aware

decision support. Expert Systems with

Applications, 36, pp. 455–463.

Fourati-Jamoussia, F. & Niamba, C. N. 2016. An

evaluation of business intelligence tools: a

cluster analysis of users’ perceptions, 6(1), pp.


Galasso, F. & Thierry, C. 2008. Design of

cooperative processes in a customer supplier

relationship: An approach based on simulation

and decision theory. Engineering Applications

of Artificial Intelligence.

Gao, S. & Xu, D. 2009. Conceptual modeling and

development of an intelligent agent-assisted

decision support system for anti-money

laundering. Expert Systems with

Applications, 36, pp. 1493–1504.

Ghazanfari, M., Jafari, M. & Rouhani, S. 2011. A

tool to evaluate the business intelligence of

enterprise systems, ScientiaIranica, 186, pp.


Ghoshal, S. & Kim, S. K. 1986. Building effective

intelligence systems for competitive

advantage. Sloan Management Review, 281,

pp. 49–58.

Gilliams, S., Raymaekers, D., Muys, B. &

Orshoven, J. V. 2005. Comparing multiple

criteria decision methods to extend a

geographical information system on

afforestation. Computers and Electronics in

Agriculture, 49, pp. 142–158.

Gonnet, S., Henning, G. & Leone, H. 2007. A

model for capturing and representing the

engineering design process. Expert Systems

with Applications, 33, pp. 881–902.

González, J. R., Pelta, D. A. & Masegosa, A. D.

A framework for developing

optimization-based decision support systems.

Expert Systems with Applications.

Goodhuea, D. L., Kleinb, B. D. & March, S. T.

User evaluations of IS as surrogates for

objective performance. Information &

Management, 38, pp. 87–101.

Gottschalk, P. 2006. Expert systems at stage IV

of the knowledge management technology

stage model: The case of police investigations.

Expert Systems with Applications, 31, pp.


Goul, M. & Corral, K. 2007. Enterprise model

management and next generation decision

support. Decision Support Systems, 43, pp.


Goumas, M. & Lygerou, V. 2000. An extension of

the PROMETHEE method for decision

making in fuzzy environment: Ranking of

alternative energy exploitation projects.

European Journal of Operational Research,

, pp. 606–613.

Granebring, A. & Re’vay, P. 2007. Serviceoriented

architecture is a driver for daily

decision support, Kybernetes, 365/6, pp. 622–

GüngörSen, C., Baraçlı, H., Sen, S. & Baslıgil, H.

An integrated decision support system

dealing with qualitative and quantitative

objectives for enterprise software selection.

Expert Systems with Applications.

Hedgebeth, D. 2007. Data-driven decision

making for the enterprise: An overview of

business intelligence applications. The

Journal of Information and Knowledge

Management Systems, 374, pp. 414–420.

Hemsley-Brown, J. 2005. Using research to

support management decision making within

the field of education. Management Decision,

, pp. 691–705.

Hewett, C., Quinn, P., Heathwaite, A. L., Doyle,

A., Burke, S. & Whitehead, P. 2009. A multiscale

framework for strategic management of

diffuse pollution. Environmental Modelling&

Software, 24, pp. 74–85.

Hung, S. Y., Ku, Y. C., Liang, T. P. & Lee, C. J.

Regret avoidance as a measure of DSS

success: An exploratory study. Decision

Support Systems, 42, pp. 2093–2106.

Koo, L. Y., Adhitya, A., Srinivasan, R. & Karimi,

I. A. 2008. Decision support for integrated

refinery supply chains part 2. Design and

operation. Computers and Chemical

Engineering, 32, pp. 2787–2800.

Koutsoukis, N., Dominguez-Ballesteros, B.,

Lucas, C. A., & Mitra, G. 2000. A prototype

decision support system for strategic planning

under uncertainty. International Journal of

Physical Distribution & Logistics

Management, 30(7/8), pp. 640–660.

Kwon, O., Kim, K. & Lee, K. C. 2007. MM-DSS:

Integrating multimedia and decision-making

knowledge in decision support systems.

Expert Systems with Applications, 32, pp.


Lamptey, G., Labi, S. & Li, Z. 2008. Decision

support for optimal scheduling of highway

pavement preventive maintenance within

resurfacing cycle. Decision Support Systems,

, pp. 376–387.

Lau, H. C. W., Ning, A., Ip, W. H. & Choy, K. L.

A decision support system to facilitate

resources allocation: An OLAP-based neural

network approach. Journal of Manufacturing

Technology Management, 158, pp. 771–778.

Lee, C. K. M., Lau, H. C. W., Hob, G. T. S. & Ho,

W. 2009. Design and development of agentbased

procurement system to enhance

business intelligence. Expert Systems with

Applications, 36, pp. 877–884.

Lee, J. & Park, S. 2005. Intelligent profitable

customers segmentation system based on

business intelligence tools. Expert Systems

with Applications, 29, pp. 145–152.

Li, D., Lin, Y. & Huang, Y. 2009. Constructing

marketing decision support systems using

data diffusion technology: A case study of gas

station diversification. Expert Systems with

Applications, 36, pp. 2525–2533.

Li, S., Shue, L. & Lee, S. 2008. Business

intelligence approach to supporting strategymaking

of ISP service management, Expert

Systems with Applications, 35, 739–754.

Lian, D. & Li D.X. 2012, Business Intelligence for

Enterprise Systems: A Survey. IEEE

Transactions on Industrial Informatics, 83,

pp. 679-687.

Lin, Y., Tsai, K., Shiang, W., Kuo, T. & Tsai, C.

Research on using ANP to establish a

performance assessment model for business

intelligence systems. Expert Systems with

Applications, 36, pp. 4135–4146.

Loebbecke, C. & Huyskens, C. 2007. Development

of a model-based net sourcing decision support

system using a five-stage methodology.

European Journal of Operational Research.

Lönnqvist, A. & Pirttimäki, V. 2006. The

measurement of business intelligence.

Information Systems Management, 231, pp.


Mahmoud, M.R. & Garcia, L.A. 2000.

Comparison of different multicriteria

evaluation methods for the red bluff diversion

dam. Environmental Modeling & Software,

, pp. 471–478.

Makropoulos, C. K., Natsis, K., Liu, S., Mittas, K.

& Butler, D. 2008. Decision support for

sustainable option selection in integrated

urban water management. Environmental

Modelling& Software, 23, pp. 1448–1460.

March, S. T. & Hevner, A. R. 2007. Integrated

decision support systems: A data warehousing

perspective. Decision Support Systems, 43, pp.


Marinoni, O., Higgins, A., Hajkowicz, S. &

Collins, K. 2009. The multiple criteria analysis

tool MCAT: A new software tool to support

environmental investment decision making.

Environmental Modelling& Software, 24, pp.


Metaxiotis, K., Psarras, J. & Samouilidis, E.

Integrating fuzzy logic into decision

support systems: Current research and future

prospects. Information Management &

Computer Security,11/2, pp.53–59.

Mohaghar, A., Lucas,k, Hoseini, F. & Monshi, A.

, Use of Business Intelligence as a

Strategic Information Technology in Banking:

inspection and fraud detection, Information

Technology Management, 11, pp. 105-120.

Moss, L.T. & Atre, S. 2003. Business Intelligence

Roadmap: The Complete Project Lifecycle for

Decision-Support Applications. Reading, MA:


Nemati, H., Steiger, D., Iyer, L. & Herschel, R.

Knowledge warehouse: An architectural

integration of knowledge management,

decision support, artificial intelligence and

data warehousing. Decision Support Systems,

, pp. 143–161.

Nguyen, T. M., Tjoa, A. M., Nemec, J. &

Windisch, M. 2007. An approach towards an

event-fed solution for slowly changing

dimensions in data warehouses with a

detailed case study. Data & Knowledge

Engineering, 63, pp. 26–43.

Nie, G., Zhang, L., Liu, Y., Zheng, X. & Shi, Y.

Decision analysis of data mining project

based on Bayesian risk. Expert Systems with


Nyblom, M., Behrami, J., -Nikkilä, T. & Søilen, K.

S. 2012. An evaluation of Business

Intelligence Software systems in SMEs – a

case study. Journal of Intelligence Studies in

Business, 2(2), pp. 51-57.

Oppong, S. A., Yen, D. C. & Merhout, J. W. 2005.

A new strategy for harnessing knowledge

management in e-commerce. Technology in

Society, 27, pp. 413–435.

Ozbayrak, M. & Bell, R. 2003. A knowledge-based

decision support system for the management

of parts and tools in FMS. Decision Support

Systems, 35, pp. 487–515.

Petrini, M. & Pozzebon, M. 2008. What Role is

“Business Intelligence” Playing in Developing

Countries? Data mining applications for

empowering knowledge societies, p. 241.

Phillips-Wren, G., Hahn, E. & Forgionne, G.

A multiple-criteria framework for

evaluation of decision support systems.

Omega, 32, pp. 323–332.

Phillips-Wren, G., Mora, M., Forgionne, G. A. &

Gupta, J. N. D. 2007. An integrative

evaluation framework for intelligent decision

support systems. European Journal of

Operational Research.

Pitty, S., Li, W., Adhitya, A., Srinivasan, R. &

Karimi, I. A. 2008. Decision support for

integrated refinery supply chains part 1.

Dynamic simulation. Computers and

Chemical Engineering, 32, pp. 2767–2786.

Plessis, T. & Toit, A. S. A. 2006. Knowledge

management and legal practice. International

Journal of Information Management, 26, pp.


Power, D. J. 2008. Data-driven decision support

systems. Information Systems Management,

, pp. 149–154.

Power, D. & Sharda, R. 2007. Model-driven

decision support systems: Concepts and

research directions. Decision Support

Systems, 43, pp. 1044–1061.

Quinn, N. W. T. 2009. Environmental decision

support system development for seasonal

wetland salt management in a river basin

subjected to water quality regulation.

Agricultural Water Management, 96, 247–

Raggad, B. G. 1997. Decision support system: Use

IT or skip IT. Industrial Management & Data

Systems, 972, pp. 43–50.

Ranjan, J. 2008. Business justification with

business intelligence. The Journal of

Information and Knowledge Management

Systems, 384, pp. 461–475.

Rashid, M.A., Hossain, L. & Patrick, J.D., 2002,

The Evolution of ERP Systems: A Historical

Perspective, Enterprise Resource Planning:

Global Opportunities and Challenges, IGI


Reich, Y. & Kapeliuk, A. 2005. A framework for

organizing the space of decision problems with

application to solving subjective, contextdependent

problems. Decision Support

Systems, 41, pp. 1–19.

Rivest, S., Bédard, Y., Proulx, M., Nadeau, M.,

Hubert, F. & Pastor, J. 2005. SOLAP

technology: Merging business intelligence

with geospatial technology for interactive

spatio-temporal exploration and analysis of

data. ISPRS Journal of Photogrammetry &

Remote Sensing, 60, pp. 17–33.

Rouhani, S., Ghazanfari, M. & Jafari, M. 2012.

Evaluation model of business intelligence for

enterprise systems using fuzzy TOPSIS,

Expert Systems with Applications, 393, pp.


Rouhani, S. & ZareRavasan, A. 2015, Multiobjective

model for intelligence evaluation and

selection of enterprise systems, 204, 394-426.

Ross, J. J., Dena, M. A. & Mahfouf, M. 2009. A

hybrid hierarchical decision support system

for cardiac surgical intensive care patients.

Part II. Clinical implementation and

evaluation. Artificial Intelligence in Medicine,

, pp. 53–62.

Sabanovic , A. & Søilen, K. S. 2012, Customers’

Expectations and Needs in the Business

Intelligence Software Market, Journal of

Intelligence Studies in Business, 2(2), pp. 5-

Santhanam, R. & Guimaraes, T. 1995. Assessing

the quality of institutional DSS. European

Journal of Information Systems, 43.

Shang, J., Tadikamalla, P., Kirsch, L. & Brown,

L. 2008. A decision support system for

managing inventory at GlaxoSmithKline.

Decision Support Systems.

Shi, Z., Huang, Y., He, Q., Xu, L., Liu, S. & Qin,

L. 2007. MSMiner—A developing platform for

OLAP. Decision Support Systems, 42, pp.


Shim, J., Warkentin, M., Courtney, J., Power, D.,

Sharda, R. & Carlsson, C. 2002. Past, present

and future of decision support technology.

Decision Support Systems, 33, pp. 111–126.

Tansel _Ic, Y. & Yurdakul, M. 2009. Development

of a decision support system for machining

center selection. Expert Systems with

Applications, 36, pp. 3505–3513.

Tan, X., Yen, D. & Fang, X. 2003. Web

warehousing: Web technology meets data

warehousing. Technology in Society, 25, pp.


Tseng, F. S. C. & Chou, A. Y. H. 2006. The concept

of document warehousing for multidimensional

modeling of textual-based

business intelligence. Decision Support

Systems, 42, pp. 727–744.

Wadhwa, S., Madaan, J. & Chan, F. T. S. 2009.

Flexible decision modeling of reverse logistics

system: A value adding MCDM approach for

alternative selection. Robotics and Computer-

Integrated Manufacturing, 25, pp. 460–469.

Wen, W., Chen, Y. H. & Pao, H. H. 2008. A mobile

knowledge management decision support

system for automatically conducting an

electronic business. Knowledge-Based


Xu, D. & Wang, H. 2002. Multi-agent

collaboration for B2B workflow monitoring.

Knowledge Based Systems, 15 pp. 485–491.

Yang, I. T. 2008. decision support system for

schedule optimization. Decision Support

Systems, 44, pp. 595–605.

Yu, L., Wang, S. & Lai, K. 2009. An intelligentagent-

based fuzzy group decision making

model for financial multicriteria decision

support: The case of credit scoring. European

Journal of Operational Research, 195, pp.


Zack, M. 2007. The role of decision support

systems in an indeterminate world. Decision

Support Systems, 43, pp. 1664–1674

Zhang, X., Fu, Z., Cai, W., Tian, D. & Zhang, J.

Applying evolutionary prototyping

model in developing FIDSS: An intelligent

decision support system for fish disease/health

management. Expert Systems with

Applications, 36, pp. 3901–3913.

Zhan, J., Loh, H. T. & Liu, Y. 2009. Gather

customer concerns from online productreviews

– A text summarization approach. Expert

Systems with Applications, 36, pp. 2107–2115.